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FOREWORD 



This report was prepared at the Manpower Research 
Center of the Naval Postgraduate School (NPS) , with 
sponsorship from the Office of the Assistant Secretary of 
Defense (Manpower, Installations, and Logistics). The 
support provided by NPS and the Department of Admini- 
strative Sciences is gratefully acknowledged. 

The report describes a dynamic experiment, from its 
inception in 1979 to its status at the end of fiscal year 
1983. Many people contributed to the project: Doctors 
W. S. Sellman, Anita Lancaster, and Janet Treichel of OASD 
(MISL) ; the members of the Joint Service Selection and 
Classification Working Group (formerly the ASVAB Working 
Group) ; other military and civilian representatives of the 
Army, Navy, Air Force, Marine Corps, the Military Entrance 
Processing Command, and the Joint Recruiting Advertising 
Program; Mr. Donald Carstensen and his staff at the 
American College Testing Program; representatives of the 
Human Resources Research Organization; and, the Army 
recruiters in Sacramento who helped shape the original 
pilot project. The information, cooperation, and advice 
provided by the representatives of all these organizations 
were essential. 

Special thanks are due to Ann Marie Murphy Martin for 
assistance with data collection during 1983, and also to 
Mary Ellen Lathrop for her contributions to data collection 
and organization of the report since January 1984. 



iii 



EVALUATION OF COMMERCIAL APTITUDE TESTING 
AS A SUPPLEMENT TO THE DOD STUDENT TESTING PROGRAM 



EXECUTIVE SUMMARY 



The Department of Defense (DoD) offers the Armed 
Services Vocational Aptitude Battery (ASVAB) for use in 
high schools and postsecondary institutions as a career 
guidance instrument, and to provide leads for recruiters to 
junior and senior students qualified for military 
training. Over 12 percent (790,000) of the nation's high 
school juniors and seniors take this battery each year, 
with about 34 percent scoring above the mean. 

Using a commercial instrument to supplement the 
student ASVAB was first proposed by the commander of the 
U. S. Army Recruiting Command (USAREC) in 1979. Explored 
under a USAREC-MEPCOM (Military Entrance Processing 
Command) contract, the concept showed sufficient promise as 
an aid to the recruiting of higher-ability graduates to 
warrant a trial period. 

Planning began in 1981 for Defense-sponsored commer- 
cial testing in 1982-1983. Two efforts were undertaken: 
(1) Army and Air Force supported testing in the Midwest and 
West with the Career Planning Program (CPP) developed by 
the American College Testing Program (ACT); and (2) DoD (on 
behalf of all the Services) sponsored testing in New 
England with the Psychological Corporation's (PsyCor) 
Differential Aptitude Tests (DAT) . 

Participation was offered primarily to non-ASVAB-using 
schools that were expected to be less inclined to cooperate 
with a DoD program than randomly chosen schools would have 
been. More than 48,000 students in over 300 schools were 
tested for the CPP pilot. The DAT pilot involved 6800 
students in 40 New England schools. 

In general, the schools were receptive to Defense 
sponsorship of a commercial battery. The reasons given 
most often for non-participation were "short notice" and 
"lack of testing time." The students tested in the CPP 
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pilot represented a cross-section of ability levels (with 
about 57 percent above the mean ) , while the students tested 
in New England appeared above-average in ability. In a 
survey taken before any follow-up information had been 
provided, one student in four participating in the CPP 
pilot reported an increased awareness of DoD opportunities 
as a result of the testing experience. 

Male students were more likely than female students 
to request either direct or indirect contact with the 
Services. Both male and female students in New England 
seemed more receptive to receiving military information 
than their counterparts in the Midwest and West. 

Reactions from the Services showed that recruiters 
found the supplemental CPP testing valuable and wanted it 
to continue. The DAT pilot, however, evoked mixed 
reactions. MEPCOM and Air Force surveys found over half 
the participating schools more receptive to information 
about the military. The Military Entrance Processing 
Stations (MEPSs) viewed the supplemental pilots as having a 
somewhat negative impact on the student ASVAB program, 
although MEPCOM reported a slight overall increase in ASVAB 
usage for the schools participating in Defense-sponsored 
commercial testing. 

Cost comparisons with the student ASVAB indicated a 
lower cost per test and per quality lead for the commercial 
instrument. Efforts to link Defense student testing to 
subsequent accessions have proven difficult, although 
measures could be developed over time. Further attention 
should be directed toward enlistments from the graduating 
classes of 1983 and 1984 in schools that offered the 
Defense-sponsored instruments. 

Experimental efforts to supplement the Defense student 
testing program with commercial aptitude tests were appar- 
ently successful in achieving the goals of: providing 
higher ability leads to recruiters, enhancing the image of 
the Defense student testing program, increasing the 
cooperation shown to recruiters in the participating 
schools, and increasing student awareness of military 
opportunities solely as a result of taking the test. In 
addition, recruiters were provided with leads that not only 
introduced students who had actively expressed an interest 
in learning more about the Service (s), but also provided a 
comfortable starting point for initial contacts with those 
students . 

The pilot programs also revealed several problem 
areas: recruiter concerns about their role in selecting 
schools for participation, absence of a student telephone 
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number on the report released to recruiters, order of the 
release items on the DoD questionnaire, and lack of infor- 
mation about the pilot projects at the local level. 
Specific recommendations were made for improvements in a 
1983-84 continuation of the CPP pilot effort. Recommen- 
dations about any future implementation of DoD-sponsored 
commercial aptitude testing will be based upon results of 
the pilot programs through the 1984 school year. 
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EVALUATION OF COMMERCIAL APTITUDE TESTING 
AS A SUPPLEMENT TO THE DOD STUDENT TESTING PROGRAM 



I. INTRODUCTION 



A. BACKGROUND 



Through the student testing program, the Department 
of Defense (DoD) offers the Armed Services Vocational 
Aptitude Battery (ASVAB) for use as a career guidance 
instrument in the nation's high schools and postsecondary 
institutions. The battery also provides military qualify- 
ing scores and "future plans" information to recruiters 
for each junior, senior, and postsecondary student tested, 
unless the school places a restriction on military access 
to the information. 

ASVAB is administered annually in over 14,000 high 
schools, but the percentage of students tested within each 
school varies greatly. On a national basis, about 790,000 
high school juniors and seniors, or about 12 percent of the 
available junior and senior student population, are tested 
with ASVAB in any school year. High schools that test 
fewer than 10 percent of their juniors and seniors appear 
to regard the Defense battery more as a military qualifi- 
cation test than as one useful for career guidance and 
counseling with all students. 

The perception that ASVAB is useful primarily for 
military qualification purposes tends to encourage the 
selection of test-takers with average or below-average 
ability levels. Thus, the leads provided to recruiters 
often fall short of meeting the Services' need for well- 
qualified or higher-ability prospects. 

An experimental project was initiated to study the 
feasibility of expanding the awareness of higher-ability 
students to opportunities available through the military. 
The project offered commercial aptitude tests to selected 
non-ASVAB-using high schools, and was intended to supple- 
ment the existing Student ASVAB Testing Program. It was 
anticipated that the experimental effort would increase 
recruiter access to higher-ability students who had 
expressed an interest in learning about education and 
training opportunities in the Service(s). 

Undertaken by the Office of the Assistant Secretary 
of Defense (Manpower, Installations & Logistics), the 
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project involved the use of two commercially-produced 
aptitude instruments in three regions of the country. 



B. PURPOSE OF THE STUDY AND ORGANIZATION OF THE REPORT 



The purpose of the study was to evaluate the 
effectiveness of the use of two different commercially- 
produced aptitude tests with non-ASVAB-using schools. Data 
for the evaluation were provided by the two testing 
organizations, the recruiting commands, and the Military 
Entrance Processing Command (MEPCOM) . The report first 
presents an overview of the history of DoD use of commer- 
cial aptitude tests, then describes each of the pilot 
projects. The recruiting command and MEPCOM reactions to 
the pilot efforts are reported, as well as program costs 
and any impact on the student ASVAB. Finally, the effort 
to offer commercial aptitude instruments in the DoD Student 
Testing Program is summarized, and recommendations are 
offered. 
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II. HISTORY OF POD DSE OF COMMERCIAL APTITUDE TESTS 



A. ORIGINAL CONCEPT 



Late in 1979, Major General William L. Mundie, then 
Commander of the U.S. Army Recruiting Command (USAREC), 
proposed that Defense should offer a commercially-produced 
aptitude test instrument to non-ASVAB-using schools. It 
was believed that such an offer would increase recruiter 
access to information for contacting high school juniors 
and seniors. 

As part of a Department of the Army contract (Lee, 
Flyer, Eitelberg, & Orend, 1982), MEPCOM and USAREC jointly 
monitored a contractual effort to investigate the use of 
commercial testing in the DoD Student Testing Program. In 
this 1979-1982 project, the Human Resources Research 
Organization (HumRRO) identified the various types of test 
data collected nationally, determined the numbers and 
characteristics of students tested, and evaluated the 
appropriateness and usefulness of the data for Defense 
purposes. After determining that DoD could obtain and use 
commercial test data for recruiting purposes, the con- 
tractor arranged for a small experimental study of a 
commercially-produced aptitude test offered under Defense 
sponsorship. 



B. PILOT PROJECT — SACRAMENTO, CALIFORNIA 



The feasibility of Defense sponsorship of a commercial 
aptitude test was evaluated in a pilot project conducted 
by the American College Testing Program (ACT) in Sacra- 
mento, California during May 1981, ACT was selected for 
this initial pilot effort as a result of HumRRO's explor- 
atory discussions with testing companies that offered 
interest, ability, and achievement tests on a national 
basis to high school students. 

Since many of the organizations contacted were not 
interested in pursuing the concept of Defense-subsidized 
testing, this quickly limited the field. Other important 
considerations included: the capacity of the aptitude 
testing program for providing ability estimates useful for 
military selection, the acceptability of the test to the 
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high school guidance and counseling community, and the 
capability for automation of student records for data 
retrieval purposes. 

Four tests were identified for more extensive eval- 
uation, after consideration of the above factors. Two of 
these, the Scholastic Aptitude Test and the ACT Assessment, 
were measures of academic ability used primarily for 
college placement. These were judged inappropriate for 
Defense recruiting purposes. The remaining instruments 
provided measures helpful for career guidance and coun- 
seling purposes: the ACT Career Planning Program (CPP) , 
and the Psychological Corporation's Differential Aptitude 
Tests (DAT) . 

Both the DAT and the CPP programs offered interest 
assessment as well as aptitude measurement, and their 
reporting formats provided individualized interpretations 
of testing results to students and high school counselors. 
Both testing organizations also expressed interest in 
Defense sponsorship or subsidization of their tests in 
selected high schools. Each was willing to enter into 
arrangements with DoD to develop a program that would serve 
the needs of high school students, the schools, and the 
military. 

Some differences between the CPP and DAT programs were 
apparent, however. The CPP program was specifically useful 
for high school juniors, and included a "local items" 
portion in the student questionnaire which could be used by 
the school (or a third-party sponsor of the test) to obtain 
additional specific information. The test, like ASVAB, 
required about three hours for administration when the 
recommended "warm-up" session was included. 

ACT used a centralized scoring facility and maintained 
individual data records in a fully-automated system. A 
precedent also existed for third-party sponsorship of the 
CPP, since ACT had previously marketed the test to commun- 
ity and junior colleges. These postsecondary institutions 
had underwritten CPP testing costs in high schools in their 
geographical areas in order to obtain access to student 
records (with student consent) for educational recruitment 
purposes. 

The DAT program at that time, however, did not score 
all tests in a central location, and had no provision for 
additional items to be included in the student question- 
naire. The DAT often was administered in the junior high 
(grades 7,8,9), rather than the high school grades (11,12) 
which interested the recruiting services. When used in 
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conjunction with its companion interest measure, the DAT 
required almost four hours to administer. 

Since the CPP already was automated to include a 
supplemental questionnaire, ACT was able to undertake the 
limited pilot on short notice. High schools in Sacramento 
were offered the opportunity to use the CPP under Defense 
sponsorship. Although arrangements for this administration 
were made very late in the 1981 school year, officials at 
the district and school levels were interested enough in 
the Defense/ACT experiment to fit the testing into their 
crowded end-of-year schedules. 

Testing was conducted in three high schools that pre- 
viously had made little or no use of the ASVAB program, and 
over 1,240 juniors and seniors participated in the 
project. ACT made all the arrangements with the schools 
for testing, but the Human Resources Research Organization 
(Lee et al., 1982) assisted with development of DoD- 
specific questionnaire items and materials. Care was taken 
to explain clearly the interest and involvement of the 
Department of Defense in subsidizing CPP testing. 

The DoD questionnaire (see Appendix A) developed for 
this project included release items which gave the student 
control over his or her test results. (The results 
included personal identifying information, responses to the 
DoD questionnaire, and CPP test answers.) The student 
chose from three options: (a) having ACT provide infor- 
mation about DoD educational and occupational programs 
through the mail (indirect contact); (b) having ACT send 
his or her test results to Defense for direct contact 
purposes; or (c) having no contact from Defense as a result 
of CPP testing. 

Option (a) generated a letter and information packet 
to the student from ACT, with a mailback card for the 
student to use if he or she wanted additional information 
from a specific Service. No information was provided to 
the Service (s) unless the student initiated the contact 
after receiving the information from ACT. Option (b) 
generated a "DoD/ACT Career Planning Program Recruiter's 
Report" that enabled a Service recruiter to contact the 
student directly. A sample report is shown in Figure 1. 
Option (c) allowed no use of the student's test results 
beyond sending them to the home school for counselor use. 

Because it would be useful both for recruiters and for 
students considering military options, ACT developed 
conversion tables to relate student scores on the CPP to 
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Armed Forces Qualification Test (AFQT)^ score ranges. A 
comparison of the CPP historical file with the 1980-81 
ASVAB testing file produced a sample of 4959 students 
taking both tests. 

Using linear regression procedures, ACT personnel were 
able to predict the AFQT with a multiple correlation of 
.84. The standard error of estimate was 14.12. Predicted 
AFQT scores were classified into the same "Categories'* used 
by DoD; extreme values of predicted AFQT scores were rare 
because of the regression effect. It was possible to 
provide an estimated AFQT score on the recruiter report for 
those students who released their information to Defense. 

Although the pilot testing in Sacramento occurred 
under adverse circumstances, (i.e., on short notice, and at 
the end of the school year) , the initial findings showed 
that 27 percent of the students were willing to be 
contacted directly by Defense. An additional 33 percent 
requested indirect contact, while 40 percent preferred no 
contact at all. Interest in military service was highest 
among male juniors, as was willingness to be contacted 
directly by Defense recruiting representatives. This 
finding suggested that male students, by the end of the 
senior year, had reasonably firm postsecondary school 
plans, while juniors were more willing to consider a range 
of possible options. 

An analysis of the characteristics of students 
choosing each of the options for DoD contact (direct, 
indirect, no contact) showed no significant differences in 
ability levels among the three groups. Students willing to 
be contacted directly reported a greater need for help in 
going to college (financial assistance, employment, 
developing study skills) than those preferring indirect or 
no contact. Students requesting direct contact also were 
more likely to believe they would benefit from a break in 
schooling, were more concerned with developing special 
occupational skills after leaving high school, and were 
more interested in military service (over 40 percent 
positive responses) . 



^AFQT; score used for determining initial qualifi- 
cation for the military. It is derived from the verbal and 
arithmetic subtests of the ASVAB. Category I indicates 
high ability to succeed in military training programs; 
Category V, the lowest grouping, is not acceptable for 
entrance into any Service. Categories I-IIIA comprise the 
upper half of the score range, the 50th percentile and 
above. 
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DOD/ACT CAREER PLANNING PROGRAM (CPP) 





RECRUITER' 


S REPORT 


♦Name : 


Abarca, George 


Responses to Military Items 


♦Address; 


100 Main Street 
Anytown, lA 66666 


1. 


Very sure of educational 
and/or vocational plans 


♦Telephone; 




2. 


Intend to continue 
education; finances not 
a problem 


♦Birthdate: 


9/22/66 


3. 


Almost impossible to 
find a full-time job 
after graduation 


♦Sex: 


Male 


4. 


Parents in favor of 
my joining the military 


♦SSN: 


384-00-000 


5. 


Counselor has encouraged 
me to look into military 
career opportunities 


♦Test 


1982 Spring 


6. 


Yes, close friend or 


Date/Name 


CPP/DOD 




relative currently 
in armed services 


♦School : 


Joplin High 


7. 


I know if qualified I 
can select the training 
and occupation I want 
before enlistment 


♦Grade: 


H.S. Junior 


8. 


Yes, I know individuals 
can have 75% of their 


Avg . H . S . 
GPA 


2.8 




tuition paid by mili- 
tary for college courses 
taken while in military 


♦Est. AFQT 
GPA 


3A 


9. 


Have not had physical 
problems 



Occupational Choice: 
Automotive body repair 



*10. Plan to go to two-year 

college after graduation 



* 



Information also provided by ASVAB-5 Recruiter Printout. 



Figure 1 
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The American College Testing Program provided HumRRO 
with copies of the CPP results plus DoD questionnaire 
responses for the students willing to be contacted directly 
to receive more information about military programs. These 
test records, designed to provide a wide range of infor- 
mation to the student and guidance counselor, were much 
more detailed than would be necessary for the military 
recruiter to use in making contact with the students. For 
this reason, an extract was developed by HumRRO and DoD 
that would combine interest and ability information with 
student responses to the 12-item Defense questionnaire. 
This extract, the DoD/ACT CPP Recruiter's Report, was then 
field-tested with Army recruiters assigned to the three 
pilot high schools in Sacramento. 

A training session was conducted at the Sacramento 
District Recruiting Command (DRC) with recruiting personnel 
who were acquainted with the schools and a number of the 
students participating in the pilot program. An overview 
of the pilot project was provided, the Recruiter's Reports 
were studied, and ways to use the information most effec- 
tively were discussed. The recruiters contrasted the 
information provided by the CPP Recruiter's Report with 
that available if a student were tested with ASVAB. 

Since recruiters traditionally rely heavily on 
telephone contacts in order to reach students, they often 
feel at a disadvantage in knowing whom to talk to, in 
developing rapport with the student, and in discovering 
which of their Service's programs might be of greatest 
interest for opening the discussion. The Sacramento 
recruiters reported that leads provided in the CPP 
Recruiter's Reports did much to bridge that gap, because 
the Reports provided an introduction to self-selected 
students who were interested in Defense programs. 

With information in hand about the student's ability 
level, interest in military service, postsecondary plans, 
occupational interests and goals, financial needs, etc., 
the recruiters could tailor their initial communications 
specifically to the individual student. The additional 
information provided in the CPP Recruiter's Reports was 
expected to enhance significantly the initial communica- 
tions between recruiters and high school students. 

This expectation was verified when the Commander, 
Sacramento DRC, reported (E. A. Levasseur, letter to 
Commander, USAREC, 8 February 1982) that the Career 
Planning Program leads had "exceptional value." The 
Sacramento District recruiters had commented: "Best re- 
cruiting tool I have!" and their supervisor had observed: 
"The CPP gives the recruiters a feeling that the prospect 
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is not a stranger." It was the DRC Commander's recommen- 
dation that sponsorship for the CPP should be implemented 
USAREC-wide. This recommendation was supported by his 
commander (C, J. Archer, letter to Commander, USAREC, 
1 March 1982) at the USAREC Western Region, who commented: 
"As the overall requirement for high school graduates 
increases within the Army, initiatives such as the one 
displayed here will become more vital." 

The pilot program using a commercial aptitude battery 
subsidized by DoD was judged successful. Military recruit- 
ers were pleased with the initial results, and both the 
testing organization and the schools which had been 
contacted were agreeable to the arrangement. Therefore, 
consideration was given to expanding the pilot program. 



C. DECISION TO EXPAND PILOT PROGRAM 



On 19 June 1981, Major General (soon to become Lieu- 
tenant General) R. Dean Tice, Deputy Assistant Secretary of 
Defense for Military Personnel and Force Management, wrote 
to offer USAREC the opportunity to extend the pilot test 
and subsidize larger-scale testing for the 1981-1982 school 
year. An information copy of the letter also was provided 
to the Commander of MEPCOM, as co-sponsor of the original 
pilot program. Major General (now General) Maxwell 
R. Thurman, then Commander of USAREC, accepted this offer 
and committed USAREC to fund the testing of 25,000 juniors, 
after consideration of the following information; 

— The expanded pilot would be made available only in 
schools where ASVAB was not used, or had been used with 
only a small proportion of students. The use of the com- 
mercial aptitude test would not compete with ASVAB. 

— The expanded pilot would produce leads in locations 
where ASVAB had not been well-accepted by the schools, such 
as California and the Midwest. The acceptance of a DoD- 
subsidized test by Sacramento high schools suggested the 
project might open new doors to recruiting. 

--The distribution of mean aptitude scores was 
expected to be the same as in the initial pilot, and 
recruiters would have greater access to the AFQT Category 
I-IIIA market than was the case with the student ASVAB. 

— The cost of administering the student ASVAB had been 
variously estimated at $3.63 per examination, or $5.65 per 
exam for the target population of juniors and seniors (Lee, 
1979), and at $1.01 per exam for all grades tested (MEPCOM 
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Testing Directorate, telephonic conununication, November, 
1980). The differences were explained in part by the 
inclusion or exclusion of: research costs, military pay 
and travel costs incurred by MEPCOM personnel, and other 
costs related to publicity materials for the program. None 
of the estimates included recruiting command expenditures 
in support of the student ASVAB program. 

— By comparison, the supplemental commercial aptitude 
test was expected to cost approximately $4.15 to $4.30 per 
student for the first 25,000 tested (with costs decreasing 
as numbers of tests increased) , with only juniors and 
seniors tested. The commercial testing organization would 
(1) provide all test materials, administration, and 
scoring; (2) contact and schedule schools; (3) train school 
counselors; (4) provide pre- and post-test information; and 
(5) prepare and mail a personalized letter to each student 
who requested information about military programs. 

After General Thurman committed USAREC to the expanded 
pilot program. General Tice offered each of the other 
Services a similar opportunity in August 1981. The Air 
Force agreed to sponsor a pilot project for 25,000 students 
similar to that undertaken by the Army. The Navy and the 
Marine Corps declined to participate at that time due to 
funding constraints. 

Having determined the wishes of the Services, the 
Office of the Assistant Secretary of Defense (Manpower, 
Installations & Logistics) then sought competitive bids for 
the project and received proposals from testing organi- 
zations capable of performing the required work. The 
Request for Proposals specified that separate contracts 
with two testing companies would be awarded — one for 
testing 50,000 high school juniors in the Spring of 1982; 
the other for 50,000 high school seniors in the Fall. 

Only one organization. The American College Testing 
Program (ACT), submitted a proposal for the Spring 
testing. The ACT proposal was technically superior (based 
on the evaluation factors), and a contract was awarded. 

Proposals were submitted by three organizations for 
the Fall testing. Two were technically acceptable, and a 
contract was awarded to The Psychological Corporation 
(PsyCor) for the second portion of the pilot testing. 

Because the two contracts involved different test 
instruments, different geographical locations, and dif- 
ferent sponsorship, they were managed separately. Chapter 
III will describe the first pilot effort, the ACT Career 
Planning Program testing project, which began in Spring 1982. 
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III. AMERICAN COLLEGE TESTING PROGRAM PILOT 



A. SPONSORSHIP AND LOCATIONS 



The ACT project (The American College Testing Program, 
1983) was composed of two parts funded separately by the 
Army and the Air Force. Each Service sponsored the testing 
of 25,000 juniors in different geographical locations, and 
received exclusive use of the student results from those 
areas . 

Initially, the selection of the ACT testing locations 
was based on minimal or no student ASVAB usage, and on the 
needs of the Services. Minnesota schools expressed 
greater-than-expected interest as a result of State-level 
endorsement of the Career Planning Program and ACT's 
aggressive marketing. In the Los Angeles area, schools 
that had used ASVAB sought information about the commercial 
testing program. These expressions of interest caused 
MEPCOM, the Command with responsibility for student ASVAB 
administration and scoring, to caution against potential 
conflict between the supplemental commercial aptitude 
testing pilot program and their own pilot program"^ to 
determine the effectiveness of centralized marketing of the 
student ASVAB. 

As a result, representatives of the Services and 
MEPCOM agreed on a list of schools which would be invited 
to participate in the ACT pilot programs. The criteria for 
selection specified that the school could not have used 
ASVAB in School Years 1980-81 or 1981-82, and was not 
scheduled for ASVAB testing in 1982-83. The Military 
Entrance Processing Stations (MEPSs) in the centralized 
marketing program were excluded from consideration for the 
commercial testing pilots beginning in Fall 1982. 



^USMEPCOM ASVAB Centralized Marketing Program. On 1 
October 1981, 17 of the Military Entrance Processing 
Stations assumed central management responsibility for the 
DoD Student ASVAB Testing Program (Hamlin, 1981). These 
MEPSs employed "ASVAB Test Specialists" with full-time 
responsibility for increasing the number of students and 
schools tested with the student ASVAB. This program was 
described and evaluated by Schneider, Morris, Waters, and 
Lee in 1984. 
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Because the ACT contract was awarded in late April, 
there was not enough time to complete the testing of 50,000 
juniors in the Spring, The ACT testing period, therefore, 
was expanded to include the Fall of 1982, with a revised 
completion date of 31 March 1983 for the project. 

Army-sponsored testing occurred in California, Iowa, 
and Minnesota in the Spring. ACT Fall testing for the Army 
continued in California and Iowa, and began in Indiana, 
Michigan and Ohio. In deference to the MEPCOM Centralized 
Marketing Program pilot at the Minneapolis MBPS, no 
further DoD-sponso r ed CPP testing was scheduled in 
Minnesota. 

Testing sponsored by the Air Force occurred throughout 
Michigan, and in Portland, Oregon and Seattle, Washington 
during the Spring 1982 portion of the pilot project. The 
Fall testing program continued in the same locations. 



B. TESTING ACTIVIT7 AND SCHOOL RESPONSE 



Initially, ACT invited approximately 725 secondary 
schools to have their students participate in the pilot 
project. The invitations were sent primarily by mail to 
schools in California, Minnesota, and Michigan. Later, a 
limited number of schools in Iowa, Oregon, and Washington 
were contacted. 

The invitation to schools summarized the ACT Career 
Planning Program and stated clearly that the Department of 
Defense was sponsoring the pilot effort. The schools were 
presented with three important components of the partici- 
pation agreement; to present the program as an every- 
student (junior) testing program, to commit their staff to 
a training session conducted by ACT staff, and to agree to 
a number of steps to ensure adequate delivery of the pro- 
ject's services. The invitation letter was accompanied by 
a reply form to facilitate school response. 

The initial reaction of the secondary school community 
to the DoD-ACT/CPP project was very encouraging, despite 
receipt of the invitation late in the school year with 
testing proposed for April or May. In Minnesota, for 
example, approximately half of the schools contacted 
responded to the invitation. The invitation was accepted 
by 45 percent of the respondents; another 40 percent wanted 
to participate but could not do so that late in the school 
year ("needed longer notice"). This second group expressed 
interest if the project were to be continued the following 
school year. 
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The timing of the project was cited most often as a 
reason for nonparticipation. Other reasons included; 
concern about DoD sponsorship and involvement, already 
offering the CPP through local funds, use of other tests, 
and dissatisfaction with tests in general. Among the 
remaining schools, 9 percent were uncertain about partici- 
pation in the pilot, and 6 percent indicated they would not 
participate . 

The receptivity of Minnesota educators and the con- 
cerns they expressed about the project proved to be 
representative of the reactions of school officials in 
other states as well. With the late Spring introduction of 
the project, ACT found that the most difficult barrier to 
be overcome was availability of time in the school calendar 
for testing students. School officials stated clearly that 
they would prefer a Fall testing with juniors (so the 
school year would be available for counseling purposes) . 
Given the time restrictions, they could not accommodate 
late-Spring testing. 

The volume of testing accomplished in the Spring, 
despite the time constraints, indicated high interest among 
secondary school counselors and principals in the DoD- 
sponsored ACT/CPP project. The total Spring participation 
level reached 22,097 students in 153 secondary schools, or 
approximately 20 percent of the schools contacted. This 
response, despite a restricted timeframe, prompted ACT to 
request and receive from DoD a contract extension to permit 
Fall testing. 

With the elimination of Minnesota schools from the 
sample for Fall testing, it was necessary to augment the 
number of schools available. This was true especially for 
the Army-sponsored portion of the pilot. ACT and the 
sponsoring Services identified additional eligible schools 
from lists of non-ASVAB-using schools provided by the 
Interservice Recruitment Committees (IRC)^ in the pilot 
project areas. This effort increased the number of poten- 
tial participants by approximately 28,000 students. In 
late August, an invitation to participate was sent to these 



^Inte rse rvice Recruitment Committees consist of the 
local recruiting commanders for each of the Services and 
the MBPS commander. In this forum, locally-responsive 
Joint-Service efforts to enhance the DoD Student ASVAB 
Program can be developed and any problems resolved. The 
IRC is the Joint-Service body with the most up-to-date 
information about student ASVAB use within its geographical 
area of responsibility. 
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schools, with a required completion date of November for 
all testing. 

Several months later, a limited number of schools were 
added to the eligibility lists. Some of these schools were 
sent letters of invitation to participate in the project, 
and the testing completion date was then extended to 
February 1983. A total of 805 non-ASVAB-using schools were 
invited to participate in the Fall 1982 project. 

The population of schools made available for the pilot 
was not representative of the nation's schools, but was 
selected based on lack of participation in the ASVAB 
program. Some of the schools were perceived by IRC members 
to be "anti-military," while others served a population not 
generally qualified for military service. Still others 
prepared their students for religious vocations, and some 
believed the Department of Defense should not recruit on 
school time. Some merely had registered their unfavorable 
opinion of ASVAB per se by declining to participate in that 
program, and were otherwise quite supportive of the 
military. Despite this difficult market, a total of 161 
schools participated in the Fall 1982 portion of the 
ACT/CPP project. This represented 20 percent of the 
invited schools, and the testing of an additional 26,323 
students. 

The reason most often given for nonparticipation 
related to the school's perception of relatively short 
notice for delivery of the project (Table 1). While this 
number was reduced significantly in the Fall (from 84 to 61 
percent) , it continued to be a major reason for nonpartici- 
pation. This may be reflective of the November completion 
deadline specified in the original invitations for the Fall 
project. 

Although the deadline subsequently was postponed until 
1 February 1983, the change was communicated in November, 
with the holidays and end-of -semester periods intervening. 
It appeared that the early announcement of a September 
through February implementation period might have produced 
a higher proportion of participating schools in the Fall. 

The numbers of schools citing self-funded use of the 
CPP and other testing programs as a reason for nonpartici- 
pation increased appreciably in the Fall. Since ACT had 
found that such budget decisions are typically made during 
the previous Spring, it was suggested that the timing of 
invitations to participate in Spring, with testing options 
available from September through March, would assist in 
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reducing the numbers of schools giving these reasons for 
nonpa rt ic ipat ion . 

Only a small number of the schools choosing not to 
participate cited an aversion to DoD sponsorship of the 
program as a reason. While this number increased for the 
Fall over Spring testing, the change may have been related 
to the method used to identify eligible schools. 



TABLE 1 

ACT CAREER PLANNING PROGRAM PILOT: REASONS 
GIVEN FOR SCHOOL NONPARTICIPATION 

(PERCENTAGE OF RESPONSE) 



Schools Invited 



Sgci. ng Fall 



Time problem — needed longer notice 84 

Not interested — no explanatory 

comment provided 5 

Aversion to military involvement 3 

Time problem — insufficient staff/ 

student time to deliver services 3 



61 

10 

7 

3 



Using some other testing service 2 



9 



Already using CPP 2 7 

Dissatisfaction with testing 

in general 2 2 



Although willingness to participate in the project was 
an obvious indicator of a school's response to the invita- 
tion, other important information could be obtained from 
questioning the students and the school project coordi- 
nators (high school counselors responsible for the DoD/ACT 
project in their own schools). Additional surveys were 
conducted by ACT to provide such reactions. 
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SCHOOL AND PUBLIC REACTIONS 



A Student survey was designed to elicit: (1) reactions 
to the CPP as a guidance/testing experience, (2) descrip- 
tions of intended use of the results, (3) opinions about 
Defense support for the project, and (4) recommendations 
about future use of the CPP with other students. The 
project coordinators in a randomly drawn sample of partici- 
pating schools were asked to have up to 100 students 
complete the survey. The responses totalled 23 schools and 
1476 students from the Spring testing, and 27 schools with 
1776 students from the Fall. The student respondents were 
almost evenly divided between males and females. 

The students were generally very positive about the 
CPP as a testing and guidance experience, and about DoD 
support for the project. About 87 percent of the students 
indicated the CPP was a very good testing experience, and 
said they would recommend a similar test be offered for 
future students. Only about 4 percent felt that it was a 
"poor idea" for DoD to sponsor such a project. 

When asked about their parents' views of the project, 
again only 4 percent reported a negative opinion. Even 
fewer (about 2.5 percent) thought their counselor was 
negative toward the Defense-supported CPP. 

The survey responses indicated that students intended 
to discuss, or had discussed, their results with a coun- 
selor (87 percent), with other students (78 percent), with 
parents (71 percent), and with teachers (23 percent). This 
high rate of self-reported plans to discuss career-related 
results, combined with the DoD mailings to students who 
requested information, suggested an increased level of 
awareness of DoD opportunities among the participants 
(students, parents, and counselors). 

In fact, over one-quarter of the students queried did 
report an increased awareness of DoD opportunities. This 
was significant because the survey was taken before either 
direct contact or mail information were initiated as a 
result of the project. The increased awareness may have 
resulted from information-seeking behaviors generated by 
the CPP materials, the DoD questionnaire, or discussions of 
the test results with counselors. The level of awareness 
of Defense occupational and educational opportunities would 
be expected to increase further, as soon as studerlts 
received the information they had requested and/or were 
contacted by recruiters. 



18 



By way of comparison, more than two-thirds reported 
no change in their awareness of military opportunities at 
the time of the survey. The question was not answered by 
2 percent, and the remaining 3 percent stated that their 
awareness had decreased as a result of the DoD-sponsored 
CPP testing experience. 

A second survey was conducted to determine the eval- 
uations and recommendations of counselors, administrators, 
parents, and school boards. Responses were received from 
75 percent of the participating schools. The project 
coordinators (counselors responsible for the DoD/ACT 
project in their own schools) reported a very positive view 
of the CPP as a tool to stimulate career planning. About 
90 percent said Defense subsidization was a good idea. 

When asked to describe the attitudes of students and 
parents to the DoD-sponsored CPP project, the coordinators 
indicated that fewer than 5 percent of the students and 2 
percent of the parents disliked the experience or were 
negative toward the idea. Highly positive attitudes toward 
the project and acceptance of Defense support were at- 
tributed to most school boards, superintendents, and prin- 
cipals. Over 92 percent of the project coordinators 
responding indicated they would recommend that their school 
participate again, if the opportunity were offered. 

Since one of the conditions of school participation 
was the notification of parents about the project and its 
DoD sponsorship, parental and administration acceptance 
were expected among participating institutions. These 
expectations were fulfilled both in the survey responses 
and in the absence of negative publicity about the ACT/CPP 
project. 

Finally, project coordinators were generally very 
pleased with the operational support provided by ACT for 
the project. Fewer than 5 percent reported negative 
responses in this area (i.e., support materials, training 
workshop, or services for getting testing materials to the 
school "were not very helpful"). The coordinators pre- 
ferred to receive invitations to participate in such a 
project in the Ma rch-Apr i 1-May time frame (about 50 
percent) or in August-September (25 percent) . The time 
most clearly preferred for conducting testing (69 percent) 
was October-November . 

Additional reactions of school counselors to the ACT 
pilot project were obtained at the annual convention of the 
American Personnel and Guidance Association (APGA, which 
subsequently was renamed American Association for Coun- 
seling and Development) . During the 1983 APGA meeting in 
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Washington, D.C., ACT convened its 20-member High School 
Advisory Council to discuss ACT services, including the 
DoD-sponsored CPP pilot. Council members agreed, with one 
exception, that the pilot had merit and should be expanded 
(N. A. Nieboer, memorandum of meeting, March 1983). The 
dissenting member criticized the DoD- student ASVAB testing 
program, and expressed concern that ACT would jeopardize 
its reputation through association with Defense. 



D. RESULTS 



More than 48,000 students in over 300 high schools, 
in designated areas of the Midwest and Far West, were 
tested during the ACT project. This served the primary 
purpose of the experimental program: to expand the 
awareness of high school juniors to opportunities available 
through military service. 

The project was well-received by the participants, who 
were fully informed about DoD purposes in sponsoring the 
testing program. The project coordinators (93 percent) and 
students (86 percent) recommended overwhelmingly that the 
project be continued in the future. In the Spring testing, 
49 percent of the responding male students and 33 percent 
of the female students requested either direct or mail 
contact with the sponsoring Service. The percentages 
increased for the Fall testing (males — 60; females — 43). 
The requested information was provided to those students at 
a time when the school was actively encouraging them to 
consider career and educational opportunities. 

Counselors from both nonparticipating and partici- 
pating high schools indicated that the time available for 
implementation of the Spring project was too limited. This 
limitation was an inescapable effect of awarding the con- 
tract in late April, and affected the number of schools 
able to participate, the number of students tested, and the 
care taken by counselors in administering the program 
(including the military-specific items) . 

With testing continuing into the Fall, it was possible 
to increase the numbers of participants, although time 
restrictions were still a factor (as described above) . For 
the Spring portion, approximately 60 percent of the partic- 
ipating schools administered the CPP to at least 80 
percent of the junior class. This increased in the Fall to 
more than 70 percent of the schools testing 80 percent or 
more of their juniors. These percentages compared to the 
national average of 12.6 percent of juniors and seniors 
tested with the student ASVAB during School Year 1982-1983. 
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The numbers of schools and students participating in 
both the Spring and Fall 1982 portions of the program are 
displayed in Table 2. These increased slightly for the 
Fall portion of the pilot. It must be reiterated that the 
institutions invited to participate in the experimental 
program were not representative of U.S. high schools. They 
were selected because they had not participated in the 
ASVAB student testing program during the previous two 
years, or had tested only a very small percentage of their 
students with ASVAB during that time. For perspective, the 
average number of students tested per session might be com- 
pared to the average of about 70 for the student ASVAB. 



TABLE 2 

PARTICIPATION OP SCHOOLS AND STUDENTS IN 
ACT CAREER PLANNING PROGRAM PILOT 









Students Tested 


Session 


Schools 

Contacted 


Number/Percent 

Participatina 


Average 

Total Per Session 


Spring 


800 


152/19 


22,097 


145 


Fall 


805 


161/20 


26,323 


164 



The students tested represented the full spectrum of 
ability levels, as measured by the Armed Forces Quali- 
fication Test (AFQT) estimate described in Chapter II. 
These comparisons and student ASVAB Categories are shown in 
Table 3. The AFQT I-IIIA ranges for CPP-tested students 
compared favorably with those for DoD accessions in 
1980-81, and the national youth population^, although 
Category I was over-represented in the CPP group. 



^ Profile of American Youth: 1980 Nationwide Adminis- 
tration of the A rmed Services Vocational Aptitude Battery 
( 1982 ) . a study sponsored by DoD in cooperation with the 
Department of Labor (DoL) . The ASVAB was administered to a 
nationally representative sample of nearly 12,000 men and 
women between the ages of 16 and 23. The AFQT was used as 
an index for comparing the test performance of military and 
civilian groups. 
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Students tested in the ACT pilot demonstrated ability 
levels somewhat higher than a nationally-representative 
sample of high school seniors tested with the CPP in 1983 
(16.1 mean estimated ACT Composite Score). The partici- 
pating students appeared comparable to the 1980 youth 
population, and also to young men and women accepted into 
the Armed Services in 1980-81. These groups all showed 
much higher percentages of scores in Categories I-IIIA than 
did the group tested with the student ASVAB. Further, the 
characteristics of the participating students suggested 
that the group was representative of eleventh-grade 
students nationally. The AFQT category scores of students 
tested with the student ASVAB, however, could not be 
assumed to be representative of the ability levels of 
either their school or their age group. 



TABLE 3 

AFQT CATEGORY DISTRIBUTIONS (PERCENTAGE) : 
STUDENT ASVAB, ACT/CPP, YOUTH POPULATION, 
AND DOD ACCESSIONS 



AFQT 


Student ASVAB 


ACT/CPP 




1980 Youth 


1980-81 


Cateqory 


SY 1979-80^ 


Est. 1982 


D 


Population*^ 


Accesjsions 


I 


1.6 


8.6 






4.4 






2.8 


II 


15.5 } 32 


32.7 


} 


57 


32.7 


} 


53 


30.3 } 5 


IIIA 


15.2 


15.6 






15.9 






20.9 


IIIB 


16.2 


20.7 






15.8 






26.4 


IV 


40.7 } 68 


22.2 


} 


43 


23.8 


} 


47 


19.6 } 4 


V 


10.7 


0.3 






7.4 






0.0 



®USMEPCOM computer files. School Year 1979-1900. AFQT Score Range 1-99} Meen 50. 

SY 1979-90 Junior end senior ASVAB date were used for comperlson with the 1980 
Youth Population. Juniors and seniors In Cetegorles I-IIIA In SY 1900-91: 32.5 
percent; SY 1981-02: 31.9; SY 1982-83: 33.9. 

^ACT Finel Report, March 1983; testing In Spring 1982. 

° Prof1 le of Amerlcen Youth . 0AS0(MRA&L], March 1982. 

‘^Defense Manpower Oete Center files, FY 1981. 



Students releasing their CPP and questionnaire 
information directly to DoD or requesting information 
through ACT (indirect contact) scored at about the same 
ability levels as all students participating in the 
project. 
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Comparisons were made using CPP average stanines, self- 
reported grade point average, estimated average ACT 
composite score, and estimated AFQT. The students 
requesting direct or indirect contact included both high- 
ability students and those with less developed skills, in 
proportions similar to their representation in the high 
school population as a whole. Table 4 shows the estimated 
ACT and AFQT scores for those tested in the Army and Air 
Force portions of the pilot project. 



TABLE 4 

AVERAGE ESTIHATED ABILITY LEVELS 
OP CPP-TESTED JUNIORS 





Army 


Air Force 


All Participants 


(N=21,100) 


(N=24,305 


ACT Composite® 


16.9 


16.8 


AFQT Estimate 


48.7 


47.8 


Juniors Releasing 
Record (Direct) 


ACT Composite 


16.3 


17.1 


AFQT Estimate 


48.0 


50.2 


Juniors Requesting 
ACT Send Information 
(Indirect) 


ACT Composite 


16.9 


17.2 


AFQT Estimate 


49.1 


49.8 



® Score Range 1-36; Mean 16.1 for 1983 high school seniors. 



In the Spring portion of the project, approximately 
11 percent (Army) and 21 percent (Air Force) of the parti- 
cipating students did not respond to the release items or 
to the military-specific items on the questionnaire. It 
appeared that the questionnaire had not been provided to 
the students in some schools, perhaps as a result of the 
limited time available for test-administration late in the 
school year. The non-response rate was reduced to only 6 
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percent for the Fall portion of the project, in both the 
Army and Air Force groups. 

Differences also were apparent from Spring to Fall 
in the willingness of students to release their records or 
request further information from the Services. As shown 
in Table 5, all students appeared more receptive in the 
Fall. In each of the groups, males were more likely than 
females to request further contact. 



TABLE 5 

PERCENTAGE OP CPP-TESTED JUNIORS REQUESTING 





CONTACT, BT 


GENDER, TESTING SESSION, 






AND 


SPONSORING 


SERVICE 










Contact 


Sponsor 


Session 


Gender 


Direct 


Indirect 


Air Force 


Spring 


Male 


25 


54 




Fall 




28 


55 




Spring 


Female 


10 


36 




Fall 




12 


41 


Army 


Spring 


Male 


17 


48 




Fall 




24 


54 




Spring 


Female 


6 


33 




Fall 




12 


42 



A review of the preliminary pilot study in Sacramento 
had shown 35 percent of the male juniors releasing their 
records directly to the Department of Defense for the 
purpose of receiving more information. Despite increases 
in the "direct contact" choice from Spring to Fall during 
the 1982-83 pilot program, the overall percentage of 
juniors releasing their records directly to the Army or the 
Air Force was considerably lower than had been anticipated. 
Several factors appear to have had an impact on this 
response. 

For the Spring 1981 pilot in Sacramento, ACT officials 
had approached participating high schools on behalf of the 



24 



Department of Defense. The release items used for that 
pilot were not specific to any Service, and referred to a 
general "DoD" category for receipt of student information. 
The fact that the release items for the 1982 projects were 
specific to only one branch of the military may have 
accounted for some of the difference in response. 

Other possible factors included an institutional 
influence on non-response, rather than student choice 
(i.e., the DoD questionnaire was not provided to students); 
and, the order of release items for the Spring 1982 
project, which allowed students to respond first to 
the item requesting information about military oppor- 
tunities through ACT. The reversal of the release items 
for the Fall portion, with the student first given the 
choice of receiving information directly from the Service, 
may have contributed to the increased preference for direct 
contact noted in the Fall. 

The tendency for students to demonstrate greater 
receptivity to Service contact (both direct and indirect) 
in the Fall portion of the pilot is shown in Table 6, in 
conjunction with the estimated AFQT. The percentages of 
students requesting contact, and the mean estimated AFQT 
category for each group, are shown by gender, test session, 
and sponsoring Service. The mean estimated AFQT category 
for all students requesting contact was IIIA, However, 
females were slightly lower with an estimated mean AFQT of 
IIIB, as were male students tested for the Army pilot in 
the Fall. 

Overall, about 48 percent of juniors tested with the 
CPP expressed an interest in the military, and requested 
either direct or indirect contact. This compared with 
about 96 percent available leads from the student ASVAB, 
where students have no choice about contact (but a small 
percentage of schools do restrict access to the students) . 
From the ASVAB leads, about 8 percent of the students typi- 
cally express an interest in the military, with 29 percent 
undecided about their future when they take the test (Lee, 
1979). The "military" and "undecided" groups, totalling 37 
percent of ASVAB leads, have traditionally been the ones 
followed-up as most productive by recruiters. 

While it was clear that 100 percent of all I-IIIA 
CPP leads were interested in military information (because 
the students specifically requested contact when offered 
the choice), the comparable percentages for students taking 
the high school ASVAB could only be estimated, since the 
individual studeit has no control over contact resulting 
from ASVAB testing. If the students who indicated "mili- 
tary" and "undecided" plans on ASVAB were assumed to have 
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abilities representative of the population tested, then 
about 34 percent of each group would fall into Categories 
I-IIIA. This assumption might be expected to overestimate 
student abilities for the "military" and "undecided" 
groups . 



TABLE 6 



PERCENTAGE AND MEAN ESTIMATED APQT CATEGORY OF CPP-TESTED 
STUDENTS REQUESTING CONTACT, BY GENDER, 
SPONSORING SERVICE, AND TEST SESSION 







SPRING 


1M2 




FALL 1982 






Female 


Total 


Male 


Female 


Total 


ARMY 














Requesting 
Contact (%) 


49 


33 


41 


58 


44 


50 


Estimated AFQT 
Category 


IIIA 


IIIB 


IIIA 


IIIB 


IIIB 


IIIB 


AIR FORCE 














Requesting 
Contact (% ) 


56 


37 


46 


60 


43 


51 


Estimated AFQT 
Category 


IIIA 


IIIB 


IIIA 


IIIA 


IIIB 


IIIA 



The Career Planning Program provided a large propor- 
tion of higher-ability student leads from individuals who 
expressed interest in receiving military information, and 
who had not been tested with the student ASVAB. These 
leads offered recruiters an excellent starting point for 
their contacts. The use of the leads by the participating 
Services, and relative costs associated with high school 
testing, will be discussed in Chapter V. 
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IV. PSYCHOLOGICAL CORPORATION PROJECT 



A. SPONSORSHIP AND LOCATIONS 



The Psychological Corporation (PsyCor) project (The 
Psychological Corporation, 1983) was sponsored by the 
Office of the Assistant Secretary of Defense (Manpower, 
Installations & Logistics) [OASD (MI&L) ] , The testing of 
50,000 seniors was to be conducted in the New England 
States, a region where recruiting has traditionally been 
difficult and the use of ASVAB with juniors and seniors was 
25 percent below the national average. The project results 
and student information were available to each of the 
Services . 

Lists of the schools eligible for invitations to par- 
ticipate in the project were provided to PsyCor by MEPCOM 
and the Services at a May 1982 meeting. The selection 
criteria were the same as described for the ACT pilot: the 
school had not tested with ASVAB in School Years 1980-81 
or 1981-82, and was not scheduled for testing in 1982-83. 

The above criteria were given to PsyCor representa- 
tives, but some confusion occurred when computer printouts 
and school lists were provided by MEPCOM and the Services. 
As a result, invitations were sent to all high schools in 
New England. However, the letter was worded as a request 
for expressions of school interest in participating in the 
Defense-sponsored program. This made it possible for 
MEPCOM to screen the schools which responded favorably to 
ensure agreement with lists of eligible schools provided by 
the Interservice Recruitment Committees (IRCs) and the 
Military Entrance Processing Stations (MEPSs) . 

PsyCor was then informed of the schools which should 
be sent Differential Aptitude Tests (DAT) materials. The 
remaining schools (interested-but-not-eligible) received 
a letter thanking them for their interest, but informing 
them that they had not been selected for participation in 
the project. 

Some schools were chosen from each of the six New 
England States: Connecticut, Maine, Massachusetts, New 
Hampshire, Rhode Island, and Vermont, but the majority of 
interested schools had been declared ineligible by the 
IRC. Thus, the number of high schools participating in the 
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Fall pilot was much smaller than had been expected. 
Several of the eligible schools choosing not to participate 
stated that they would be willing to test their juniors (or 
sophomores, or freshmen), but not seniors (who were assumed 
to have made their post-graduation plans) . 

By mid-September, some modifications were necessary 
in order to gather adequate data from this project. At a 
meeting attended by PsyCor, MEPCOM, the Services, and OASD 
(MI&L) representatives, it was decided that the project 
should be expanded to include testing of juniors and sen- 
iors in the Spring of 1983. 

Invitations again were extended to all eligible New 
England schools to inform them of the time extension and 
modification of the project. The schools were advised that 
testing could continue through the Spring of 1983, and that 
both juniors and seniors could participate in the project. 
The final total of 40 participating schools was distributed 
as follows; Connecticut — 8; Maine — 6; Massachusetts — 20; 
New Hampshire — 1; Rhode Island — 4; Vermont — 1. 



B. TESTING ACTIVITY AND SCHOOL RESPONSE 



With the goal of testing 50,000 seniors in the six 
states, the Psychological Corporation originally conveyed 
invitations to 693 schools through mailings and visits from 
sales representatives. "The Defense Department's purpose 
in sponsoring the DAT testing program was fully explained 
to officials at selected schools" (PsyCor, 1983), and 
follow-up telephone calls were made as necessary. 

The letters of invitation mailed to the schools 
informed them of "an important pilot study" being conducted 
by PsyCor for DoD, which would allow the administration of 
the DAT "to your high school seniors free of charge in 
October 1982" (PsyCor, 1983, Appendix A). A fact sheet was 
enclosed to provide details of the study and the benefits 
of participation for both the students and the schools. 

A letter of agreement was included in the package to 
allow schools to indicate their interest in participating. 
The letter stated that the determination of the final 
sample would be made in accordance with regional sampling 
requirements, and that all schools expressing interest 
would be notified as to whether or not they were included 
in the study. 

The initial invitations were mailed in May 1982, and 
it soon was evident that many schools testing with ASVAB 
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had been included. The selection of eligible schools from 
those responding was made by MEPCOM and OSAREC represent- 
atives in early August, at the request of the OASD(MI&L) 
contract monitor. Only 32 of the 119 schools expressing 
interest in the study were determined to be eligible for 
participation. 

With fewer than 4 percent of the schools participating 
(although 17 percent had actually expressed interest) , the 
initial response from New England schools was not encour- 
aging. The maximum number of seniors available in those 
schools was below 5,000. Thus, it appeared that less than 
10 percent of the testing goal for this study would be met 
if PsyCor followed the original plan of testing seniors in 
October 1982. 

Approximately one-quarter of all the schools receiving 
invitations had replied to PsyCor *s marketing efforts. Of 
the 50 schools responding negatively, almost all cited 
reasons for the decision. The most frequent was "inability 
to find the necessary testing time," followed by having 
DAT scores already available for the students. Several 
said their testing program was already complete. One 
school would participate if the testing were voluntary; 
another preferred to test sophomores only. 

A few of the schools referred to previous unfortunate 
experiences with ASVAB testing and/or DoD recruiters. One 
respondent was not willing to have DoD contact students for 
any reason; another declined to participate in a test that 
was mandatory for all seniors. On a more positive note, 
several schools expressed support for the study, and 
reported they would participate if students could be tested 
earlier than the senior year. 

It appeared that participation would be limited 
because of the restrictive nature of the invitations (a May 
invitation for schools to test seniors in October on a 
mandatory basis) . Because additional data were needed and 
some nonparticipants had indicated support for the concept 
of the study, OASD(MISL) requested that the Psychological 
Corporation extend the testing time into the Spring of 
1983. PsyCor agreed to the extension, and information 
packets were sent in October to 208 schools from a list 
provided by DoD. The schools were invited to participate 
in the Spring continuation with the testing of juniors 
and/or seniors. 

The population of schools made available for the pilot 
project was not representative of the nation's schools, or 
in this instance, even of those in New England. The 
selection had been made at the Interservice Recruitment 
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Committee level of schools which had not used ASVAB, and 
in which the local representatives had no expectation of 
scheduling the DoD student test. 

In this admittedly difficult market, a total of 25 
high schools participated in the Fall 1982 portion of the 
DAT project, and 3354 seniors were tested. For the Spring 
1983 extension, 24 schools tested 401 seniors and 3075 
juniors. This produced a total of 6830 students tested in 
40 schools for the entire project (9 schools participated 
in both portions) . The participation rates by type of 
school were nearly identical for the Fall and Spring 
tests. Twelve public, 10 parochial, and 3 private schools 
took part in the Fall, while the corresponding numbers for 
the Spring were 11 public, 10 parochial, and 3 private. 
Five public and 4 parochial schools participated in both 
the Fall and Spring testing. 



C. SCHOOL AND PUBLIC REACTIONS 



Although school reactions to the Defense-sponsored 
Differential Aptitude Testing pilot program were not 
surveyed directly, school participation rates did provide 
an indicator. Parochial schools were considerably more 
likely to participate than were either public or other 
private institutions. About 25 percent of all parochial 
schools contacted, and about 10 percent each of public and 
private schools, participated in the PsyCor study. 

Because the invitations extended to the schools 
included clear statements about Defense sponsorship of the 
study and the students* right to release or withhold their 
personal information, it was anticipated that there would 
be no negative reactions from the parents or governing 
boards of schools which chose to participate. This 
appeared to be the case in all but one school. 

The principal of a public school in Massachusetts had 
agreed to participate in the study, and tested about 500 
seniors in the Fall. He then had to destroy the student 
answer sheets because an angry parent objected to the local 
school committee [board] . The concerns centered around 
student participation in a Defense-sponsored testing 
program, and objections to the DoD questionnaire which was 
alleged to be an invasion of privacy. 

what seemed to be a problem of internal communication 
in one school system was reported by local news media. 
This resulted in several Boston-area newspaper articles and 
a request for investigation by the Ethics Committee of the 
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American Psychological Association (APA) . The APA Ethics 
Committee found (Fisher, 1983) no conflict between this 
program and sound ethical principles, since it was made 
clear to the students that DoD sponsored the test, and stu- 
dents could choose not to complete the questionnaire. 

An article about DoD-sponsored testing also appeared 
in The American School Board Journal . In its report ("A 
Military Recruiting," 1983), the Journal included refer- 
ences to the Ann Arbor, Michigan schools' participation in 
the American College Testing (ACT) Program's pilot project 
and mentioned ACT's concern about not only informing 
parents, but also involving them in the students' testing 
process. (The articles are included as Appendix B.) 



D. RESULTS 



The Psychological Corporation project tested 6830 
students in 40 New England high schools, far short of the 
goal of 50,000 students tested. The objective of expanding 
the awareness of high school seniors (and later juniors) to 
opportunities available through military service was met, 
however, in the participating schools. 

The project was well received in schools which chose 
to participate. The participation rate increased somewhat 
from Fall to Spring, as shown in Table 7. If only eligible 
schools had been contacted initially, the participation 
rate for Fall would have approached 10 percent. 



TABLE 7 



PARTICIPATION OF SCHOOLS AND STUDENTS IN 
PSYCHOLOGICAL CORPORATION PILOTS 



Students Tested 



Schools Number/Percent 



Average 

T.b.t.ftl Per S.g.s,si.Qi> 



Sssgigp Centaeted Participating 
Fall 1982 693^ 25/ 4 



25/ 4 



3354 



134 



Spring 1983 208 



24/12 



3476 



145 



^Included ineligible schools not selected for participation 
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student participation rates for the "mandatory" 
testing were higher in the Fall for all schools. The 
testing of about 95 percent of their seniors gave private 
schools the highest rates in the Fall, while parochial 
schools took the lead in the Spring (about 92 percent of 
juniors and seniors testing) . Participation was some- 
what higher among males in the Fall, but no significant 
differences were evident between percentages of males 
and females tested during the Spring testing. The ethnic 
composition of the students tested was consistent for both 
the Fall and the Spring studies: Whites accounted for 
about 94 percent. Blacks for about 3 percent, and Hispanics 
for about 2 percent. In addition, private schools reported 
testing about 10 percent Oriental students in the Spring. 

An estimated AFQT score had been developed from an 
equating study in which both DAT and ASVAB subtests were 
administered to Air Force and Army personnel (PsyCor, 
1983) . The selected subtests (DAT Verbal Reasoning [VR] 
and Numerical Ability [NA] ; ASVAB Arithmetic Reasoning, 
Word Knowledge, Paragraph Comprehension, and Numerical 
Operations) were administered to 295 Air Force recruits at 
Lackland Air Force Base, Texas, and to 292 Army recruits at 
Fort Dix, New Jersey. Using a final sample of 586 
subjects, after the elimination of one unusable score, 
PsyCor staff computed correlation coefficients among the 
VR+NA score of the DAT, raw scores on the four ASVAB tests, 
and the AFQT score. The results suggested that the sample 
of recruits performed at about the same level as a nation- 
wide sample of eleventh graders when compared to the Fall 
1980 standardization sample for the DAT (mean — 50.6; 
standard deviation — 19.5). 

The correlation between the VR+NA score and the AFQT 
score was .78. The multiple correlation coefficient was 
also .78, leading PsyCor to conclude that the simple sum 
of raw scores on the VR and NA tests could not be measur- 
ably improved as a predictor of AFQT. The use of Service 
personnel for the equating eliminated any scores in 
Category V. Thus, PsyCor reported estimated AFQT scores 
for Categories IVA and IVB- (i.e., IVB and below) for 
students in the pilot, rather than estimating the boundary 
between Category IV and Category V. 

Overall, the ability levels of the students tested 
were apparently well above average (about 75 percent in 
AFQT Categories I-IIIA) . Table 8 shows the profile of 
estimated AFQT scores for DAT-tested juniors and seniors in 
participating high schools in the New England States, as 
well as the nationwide profiles for the student ASVAB, the 
1980 Youth Population, and DoD accessions. 
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TABLE 8 



APQT CATEGORY DISTRIBUTIONS (PERCENTAGE) : STUDENT ASVAB 
AND DAT, YOUTH POPULATION, AND DOD ACCESSIONS 



AFQT Student DAT 

Category ASMEJLMg® 



1980 Youth 1980-81 
Population ^ Accessions ^ 



I 


1.6 






8.4 






4.4 






2.8 


II 


15.5 


} 


32 


44.4 


} 


73 


32.7 


} 


53 


30.3 


IIIA 


15.2 






20.4 






15.9 






20.9 


IIIB 


16.2 






15.5 






15.8 






26.4 


IV 


40.7 


} 


68 


6.5 


} 


27 


23.8 


} 


47 


19.6 


V 


10.7 






4.8 






7.4 






0.0 



“USMEPCOM computer filast School Year 1979-1980. AFQT Score Range 1-99; Mean 50. 

SY 1979—80 Junior and aanior ASVAB data uaad for comparison with 1980 Youth 
Population. Juniors and saniors in Catagorias I-IIIA in SY 1980-81: 32.5 parcant; 
SY 1981-82: 31.9 percant; and» SY 1982-83: 33.9 parcant. 

‘•psyCor Final Report, July 1983. DAT IV=IVA; DAT V=IVB and V. 

^ Profile of American Youth . 0ASO(MRA&L), March 1982. 

"Oefanaa Manpower Data Center files, FY 1981. 



Students tested in these schools in New England 
appeared to be far above average when compared to those 
tested with student ASVAB or in the National Youth Popula- 
tion. This seemed consistent with the representation of 
private and parochial schools in the sample, and with 
scoring patterns for nationally-administered instruments 
such as the Scholastic Aptitude Test (SAT). While sex 
differences were not great, males typically earned higher 
estimated AFQT scores in the Fall testing and females 
scored higher in the Spring, as shown in Table 9. 

When offered the chance to learn more about military 
opportunities, about 38 percent of the students tested with 
the Defense-sponsored DAT chose to receive the information 
directly from recruiters (Table 10). Another 31 percent 
preferred to have PsyCor mail the information to them. 
Male students were more inclined to receive the information 
directly, while females preferred the direct option in the 
Fall and the indirect option in the Spring. 
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TABLE 9 



PERCENTAGE AND MEAN ESTIMATED APQT CATEGORY 
OP DAT-TESTED STUDENTS REQUESTING CONTACT, 
BY GENDER AND TEST SESSION 



F4LL 1 9. 82 SPRING 1983 





Male 


Female 


Total 


Ma^le 


Female 


Total 


Request Contact 


66 


70 


68 


70 


70 


70 


Estimated AFQT 


II 


IIIA 


II 


IIIA 


II 


IIIA 



The 38 percent of DAT-tested students releasing their 
scores to DoD was appreciably higher than the 27 percent 
of juniors and seniors in the initial pilot project in 
Sacramento, California (Lee et al,, 1982), Since juniors 
in the initial pilot had shown more interest than the 
seniors in hearing directly from DoD (35 percent of the 
juniors released their scores), this may have indicated a 
difference between seniors in the participating schools in 
New England and those in Sacramento, or may have reflected 
societal changes from 1981 to 1983 (e.g., economic, 
resurgence of patriotism, etc.). 

The low percentages of student ASVAB testing in New 
England had given rise to a notion among some recruiting 
and Defense manpower personnel that school counselors in 
that region were opposed to the military test battery. An 
alternate interpretation would have been that the coun- 
selors were actually opposed to the military. In this 
context, it was interesting to note that although only 
about 12 percent of the invited schools chose to parti- 
cipate in this program of Defense-sponsored DAT testing, 70 
percent of the students tested expressed an interest in 
receiving more information about Defense programs. This 
may have indicated a lack of attention from Service 
recruiters toward schools considered low priority or 
"difficult" (i.e., refused ASVAB, were unenthusiastic 
toward military recruiting efforts, had few or no graduates 
enlisting) , or may have signalled that school officials 
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were more restrictive of military information than desired 
by the students. 



TABLE 10 

PERCENTAGE OF DAT-TESTED STUDENTS REQUESTING 
CONTACT, B7 GENDER AND TESTING SESSION 



Contact Requested 



Session 


Gender 


Direct 


Indirect 


Fall 1982 


Male 


41 


25 




Female 


37 


33 




Total 


39 


29 


Spring 1983 


Male 


42 


28 




Female 


32 


37 




Total 


37 


33 



When the DAT leads were compared to the leads avail- 
able from DoD student ASVAB testing, it was noted that 



^A recent report by the Educational Testing Service 
(Hilton, Schrader, & Beaton, 1983) provided some support 
for the hypothesis that school counselors and teachers may 
not have been as willing to suggest the military as an 
option as were others in the student's life. When asked 
what significant others thought they "ought to do after 
high school," seniors reported their counselors and teach- 
ers were less likely to say "military" than were their 
parents or peers. The differences were widest in New 
England, as shown below. 

When asked, "What does your father [etc.] think you 
ought to do after high school?", the percentages answering 
"military" were as follows: 



New 


England 


Father 


Mother 


Counselor 


Teachers. 


Peers 


All 


Students 


5.6 


3.7 


0.8 


0.7 


3.2 




Males 


8.5 


5.8 


1.3 


1.0 


6.0 




Females 


3.4 


2.0 


0.5 


0.4 


1.1 
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about 70 percent of the students tested with the DAT 
requested either direct or indirect contact from the 
military. Of these leads, 73 percent were estimated to be 
in AFQT Categories I-IIIA. This percentage compared 
favorably with both the student ASVAB and Defense-sponsored 
ACT/CPP for quality of leads provided to recruiters. 

The Psychological Corporation found no important rela- 
tionship between the type of contact authorized and the 
estimated AFQT category of the student. This held true for 
responses to most of the DoD questionnaire items as well, 
with the exception of "plans after graduation." In 
responding to this question, students with estimated scores 
in AFQT Category II chose "four year college" more fre- 
quently than other options. Students with an estimated 
AFQT in Category IIIB tended to choose "get a job." For 
those students choosing the option of "join the military," 
the estimated AFQT was typically in Category IIIA, 

Students releasing their information for direct 
contact by DoD were more likely (60 percent) to report that 
their parents were "neutral" or that they "don't know" 
their parents' attitude toward the student's joining the 
military. From 75 to 90 percent of all students in the 
Fall and Spring studies indicated that their guidance 
counselor had not discussed military career opportunities 
with them. 

About two-thirds of the students said they were aware 
that qualified persons could select training before 
entering the military. Males chose the affirmative 
response with greater frequency than females. There was a 
slight tendency for these better-informed students to 
authorize direct contact, rather than indirect contact or 
none at all. 

The higher ability of the students who expressed 
interest in receiving military information, plus the addi- 
tional information available from the DoD questionnaire, 
provided recruiters with an excellent starting point for 
their contacts. The use of these leads by the Armed 
Services, as well as any impact on the student ASVAB 
associated with DoD-sponsored commercial aptitude efforts, 
will be discussed in Chapter V. 
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V. BVM.DATI01!I OF SDPPLEWEMTAL COHHERCIAL TESTING 



A. AVAILABILITY OF DATA 



The evaluation of efforts to supplement the Defense 
Student Testing Program with commercial aptitude tests was 
based on information provided by all organizations involved 
in the pilot projects. The information included the 
results of surveys by the testing companies and recruiting 
commands, specific supplemental aptitude testing data, 
student ASVAB activity, and recommendations. The method of 
reporting, the metric, and the completeness of the infor- 
mation varied considerably from source to source. 

The American College Testing Program and The Psycho- 
logical Corporation provided information about reaction in 
the secondary school community to Defense sponsorship of 
a commercial instrument. ACT also provided data from 
follow-up surveys of school officials and students, and 
described the characteristics of participating students. 

Each of the recruiting commands provided such infor- 
mation as it deemed appropriate, in reply to the request 
for data from the Office of the Secretary of Defense 
(OSD) . The Service responses ranged from reports by 
school, to summaries of command surveys, to anecdotal com- 
ments from the field. These varied in length and in the 
amount of information provided. Excerpts are included, 
with the reports attached as Appendix C. 

MEPCOM provided indications of impact on the student 
ASVAB program in terms of actual testing activity among 
schools participating in the pilot projects. Test coord- 
inators and test specialists in participating MEPSs also 
were surveyed for their perceptions of DoD-sponsored 
commercial aptitude testing. The Services provided some 
feedback about school attitudes toward using ASVAB, and any 
changes in test usage attributed to the commercial pilots. 



B. QUALITY OP LEADS 



A major factor in the decision to undertake commercial 
testing pilot programs had been the recognition that the 
student ASVAB was not reaching enough higher-ability young 
people. Both commercial pilot programs greatly exceeded 
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the percentage of junior and senior student ASVAB test- 
takers with estimated AFQT scores in Categories I-IIIA. 

The students who participated in the CPP and DAT pilot 
programs were average to above-average in the abilities 
measured by these instruments. They- were almost twice as 
likely to score in Categories I-IIIA as were ASVAB-takers 
(Table 11). This difference was demonstrated most dramati- 
cally in New England testing with the DAT, which included a 
high proportion of private and parochial schools. The ACT 
sample, from the Midwest and the Pacific coastal states, 
appeared quite similar to the 1980 youth population, and 
also resembled closely the CPP national profile. 



TABLE 11 

AFQT CATEG0R7 DISTRIBUTIONS (PERCENTAGE) : STUDENT ASVAB, 
YOUTH POPULATION, CPP, AND DAT PILOT PROGRAMS 



AFQT 

Category 

I 

II 

IIIA 

IIIB 

IV 

V 



student 
ASVAB 1983 

1.8 

16.6 } 34 

15.5 

16.5 

39.9 } 66 
9.5 



1980 Youth 
Population 

4.4 

32.7 } 53 
15.9 

15.8 

23.8 } 47 

7.4 



ACT/CPP 

Estimate 

8.6 

32.7 } 57 

15.6 

20.7 

22.2 } 43 
0.3 



DAT^ 

Estimate 

8.4 

44.4 } 73 

20.4 

15.5 

6.5 } 27 

4.8 



^Category IV=IVA; V=IVB and V. 



Because the percentages of students with estimated 
scores in AFQT Categories I-IIIA were much higher for those 
tested with the subsidized commercial tests, a comparison 
was made of actual student ASVAB AFQT scores in the same 
MEPS. Student ASVAB testing profiles for the MEPSs 
involved in the CPP and DAT pilot projects were compared 
with the national data for junior and senior students 
tested with ASVAB in 1982-1983. The percentages scoring 
above the mean were slightly higher in the pilot MEPS. 

Nationwide, 78 percent of the high schools tested 12 
percent of their juniors and seniors with ASVAB (Table 12) . 
Of the juniors and seniors tested, 34 percent achieved 
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scores in AFQT Categories I-IIIA. The highest percentage 
of schools testing with the student ASVAB was found in the 
New England MEPSs, as was the largest percentage of juniors 
and seniors scoring in AFQT Categories I-IIIA, The CPP and 
DAT pilot MEPSs, as was expected, tested smaller percent- 
ages of their juniors and seniors than the national 
average. 



TABLE 12 

MBPS COMPARISONS FOR SY 1982-83: PERCENTAGES OP SCHOOLS 
AND JUNIORS/SENIORS TESTED, AND JDNIORS/SENIORS 
SCORING IN CATEGORIES I-IIIA IN EACH GROUP 



Student ASVAB Testing 





Percent 


Teste<? 

Juniors/ 


Percent Scoring in 
Categcries 1 -IIIA 


MEPSS 


Schools 


Seniors 


Juniors/Seniors 


DAT Pilot 


82 


9 


38 


CPP Pilot 


70 


7 


36 


All MEPSs 


78 


12 


34 



Data from MEPCOM ASVAB Institutional Testing Report, 
SY 1982-83 summary, as of 30 June 1983, 



Students participating in the pilot programs expressed 
varying degrees of interest in receiving further infor- 
mation about the Armed Services. The interest differed 
with gender, time of testing (i.e,. Fall or Spring), and 
geographical location, and appeared highest among male 
juniors. 

Gender differences were more noticeable in the Midwest 
and West, with females much less likely to request either 
direct contact from recruiting representatives or infor- 
mation through the mail. In New England, both male and 
female students were receptive to hearing more about the 
military. The patterns of requests for contact are shown 
in Table 13, by gender, location, and the type of contact 
preferred. 
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TABLE 13 



PERCENTAGE OP PILOT-TESTED STUDENTS REQUESTING CONTACT, 
BY GENDER, LOCATION, AND TYPE OF CONTACT REQUESTED 



Location 


Gendex 


Contact 

Direct 


Requested 

Indire< 


Midwest/West 


Male 


23.5 


52.8 


(ACT) 


Female 


10.0 


38.0 


New England 


Male 


41.5 


26.5 


(PsyCor) 


Female 


34.5 


35.0 



In each of the pilot projects, interest in receiving 
information increased for the second testing session. This 
was evident especially among the female students. This 
change may have been a product of the longer planning time 
available to school personnel, with correspondingly lower 
pressure to rush students through the pre-test paperwork. 
In the ACT pilot, some portion of the change may have been 
attributable to the reversal of the release items for the 
Fall testing. The student was offered first the oppor- 
tunity to release his or her information directly to the 
Service; the option of receiving information through the 
mail was listed second. The opportunity to receive 
information from ACT had been offered first for the Spring 
testing. 

Although the proportion of total leads available from 
the pilot programs was lower than from the student ASVAB, 
the percentages of AFQT Category I-IIIA leads were far 
higher. When the degree of student interest in military 
information was included in the equation, the pilot pro- 
grams had a clear advantage: 100 percent of the leads from 
commercial testing had expressed interest by actively 
requesting information from a Service or Services. These 
students were expected to be receptive to learning more 
about training and educational opportunities in the 
military. 

By comparison, about 37 percent of the ASVAB leads 
indicated their plans were either "military" or 
"undecided," and, thus, were expected to be interested in 
learning more about military programs. The anticipated 
percentages of military interested leads with scores in 
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AFQT Categories I-IIIA were as follows: ASVAB — 34; 
ACT — 57; DAT — 73. The DAT scores reflected only testing 
done in selected New England schools, and were not consi- 
dered to be nationally representative. The ACT results, on 
the other hand, appeared representative of both the CPP 
national sample and the 1980 youth population. (Leads from 
ASVAB and the pilot programs are depicted in Figure 2.) 
The ASVAB AFQT percentages may be slightly higher than the 
national average for the geographical areas tested with CPP 
(2 percent) and DAT (4 percent). 



LEADS AVAILABLE FROM PILOT PROJECTS AND STUDENT ASVAB: 
AFQT CATEGORY I-IIIA AND INTERESTED IN 
MILITARY INFORMATION® 



I-IIIA LEADS 
(% OF TOTAL 
TESTED) 



INTERESTED 
IN MILITARY 
INFORMATION 
(% OF ALL 
LEADS) 



I-IIIA LEADS 
INTERESTED 
IN MILITARY 
INFORMATION 
(% OF ALL LEADS) 




ASVAB CPP DAT ASVAB CPP DAT ASVAB CPP DAT 

34% 57% 73% 37% 100 100 13% 57% 73% 



®Leads interested in military information includes ASVAB 
"military" plus "undecided" responses and CPP or DAT 
requests for direct or indirect contact. 



Figure 2 
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The first graph, "I-IIIA Leads," shows the expected 
percentages of leads which fell into the upper half of the 
AFQT distribution. "Interested in Military Information," 
the second graph, depicts the percentage of ASVAB leads 
indicating plans after graduation as "military" or "unde- 
cided," and the percentages of students in the commercial 
pilots who actively requested further military information. 



The third graph, "I-IIIA Leads Interested in Military 
Information," shows the percentages of all leads expected 
to qualify in AFQT Categories I-IIIA and expressing 
interest in military information. The CPP pilot appeared 
to produce more than four times as many quality leads as 
ASVAB (57 VS. 12,5 percent). Because the students tested 
in the CPP pilot appeared representative of high school 
juniors nationally, the CPP results were used in drawing 
comparisons between the commercial aptitude testing 
pilots and the student ASVAB. 



As the indirect leads were considered (those students 
who had requested information through the testing organiza- 
tion) , two subcategories emerged. The first was a measur- 
able group of students who returned a business reply card 
to request further information. This was followed by an 
unmeasurable group who took the initiative themselves and 
contacted a Service representative directly. The second 
group of students may, or may not, have told recruiter (s) 
that they had taken the DoD-sponsored aptitude test and 
were following up on information they had received from the 
testing organization. 



The Air Force found (R.R. Campbell, memorandum for 
W. S. Sellman, OASD(MI&L), 2 July 1984) that 10.5 percent 
of those students became direct leads by returning the card 
to request more information. This compared with a 2,4 
percent rate of return for business reply cards from the 
Joint- Service DAT pilot. 



As of 30 September 1983, the Joint Recruiting Adver- 
tising Program (JRAP) had turned over 50 leads to the 
Services from cards returned by students who had received 
DoD information from PsyCor (Air Force — 18; Army — 10; 
Navy — 13; Marine Corps — 9) (Y. LaPorte, personal communi- 
cation, 17 October 1983), The projected return rate had 
been in the range of 2-4 percent, for this type of mailing 
in which no promotional "giveaway" item was offered. 
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c. 



OSER REACTIONS 



The reactions and coininents of each participating group 
were considered and reported separately. Information about 
the schools is followed by a section for each of the 
Services and MEPCOM. 

1, Participating Schools 

The first indication of reactions from the secondary 
school community toward Defense sponsorship of commercial 
aptitude tests came from the initial pilot project in 
Sacramento, California. That response was favorable, and 
an accurate indicator of reaction to the 1982-1983 pilots. 

Schools which had been selected for Defense-sponsored 
commercial testing largely on the basis of having refused 
to participate in the student ASVAB program seemed recep- 
tive to the use of other well-regarded instruments. The 
participation rate among schools contacted by the American 
College Testing Program was 1 in 5, with more than 150 
students tested in each session. The primary reason for 
nonparticipation expressed by respondents was "lack of 
time." 



In New England, about 1 in 10 of the schools contacted 
by The Psychological Corporation agreed to participate. 
The reasons cited for declining the invitation included 
lack of time or scheduling difficulties, with some already 
having DAT scores available for their seniors. An average 
of 140 students were tested in each session in this pilot. 

Students participating in the ACT pilot program were 
given the opportunity to express their feelings in a survey 
made some time after the testing session, but before they 
had received any additional military information. About 
87 percent of the students felt the testing had been a 
positive experience, and only 4 percent thought Defense 
sponsorship was a "poor idea." 

More than 1 in 4 of the students reported having an 
increased awareness of Defense opportunities as a result 
of the testing. This was interesting because the survey 
was made before any follow-up recruiting contact occurred 
or any information had been mailed. The experience of com- 
pleting the supplemental questionnaire, perhaps coupled 
with counselor discussions, may have been the catalyst for 
the heightened awareness. 

A survey of the school officials who served as project 
coordinators provided feedback from counselors. 
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administrators, parents, and school boards. ACT received 
responses from 75 percent of the schools participating in 
the pilot. The project coordinators were very positive 
about the use of the CPP, and over 90 percent felt that DoD 
support of the project was a good idea. Highly positive 
attitudes about the project were also attributed to most 
school boards, superintendents, and principals. 

Positive reactions were expressed in person during the 
March 1983 convention of the American Personnel and 
Guidance Association (since renamed American Association 
for Counseling and Development) by counselors participating 
in, or aware of, the pilot projects. In addition, verbal 
comments and letters expressing interest and support for 
the concept were received by the author, ACT staff, and 
recruiting service personnel since the initial pilot 
project ended. These comments often included the percep- 
tions that the image of DoD programs was enhanced by 
affiliation with a well-regarded commercial test, and that 
cooperation shown toward military recruiters would increase 
in the participating schools. 

2. Army 

In its final summary of the ACT 1982-83 pilot project, 
the Army reported favorable reactions from both the schools 
and the District Recruiting Commands (DRCs) . 

Some recommended continuing this program 
only for schools not ASVABing; some said 
expand it; but all said continue it! The 
initial results are favorable and cer- 
tainly the contractor has done a credit- 
able job. Improvements/refinements are 
anticipated this year in the program (Zaldo, 

21 October 1983) . 

Commenting on the student results provided to 
recruiters, the Army stated that the information "provided 
good insight on prospective applicants." In discussing the 
value of the CPP and of ASVAB, it was noted that "...in 
some cases, the commercial test was the instrument that 
permitted increased access to schools." 

The recruiting districts attributed these reactions to 
participating schools: "CPP arouses the interest of 

students who may not be stimulated by ASVAB participation." 
"Counselors prefer the results received [from CPP] to those 
received from ASVAB testing. ACT has credibility with the 
educational community not enjoyed by the authors of ASVAB." 
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The self-reported DRC responses included; 

The ACT/CPP is most helpful in gaining access 
to areas where little or no information pre- 
vails. Although it is not as effective as 
ASVAB 5, it often propels a school to ulti- 
mately utilize the ASVAB test. 

Recruiter reaction seems to be favorable with 
comments such as; "test provides much more 
detailed information with which to conduct 
interviews," and "easily readable format for 
all involved with the program." 

The program can be very economical and most 
useful in eventually getting contracts. It 
is an excellent method of public service to 
the schools. CPP arouses the interest of 
students who may not be stimulated by ASVAB 
participation. CPP should be applied on a 
more widespread level. 

The Army final report pointed out that a possibility 
existed that the CPP was viewed in the field as a potential 
replacement for the student ASVAB, and therefore, as compe- 
titive. This belief, despite Headquarters statements that 
such was not the case, could have had an adverse effect on 
reporting efforts for the pilot program and on the ASVAB 
program itself, depending upon each reporter's views. 

In contrast to the positive reactions expressed for 
the ACT pilot. Army reported mixed reactions to the PsyCor 
project (Zaldo, 21 October 1983), Most of the New England 
schools were said to favor the program, although some had 
reservations about completing the DoD questionnaire. Some 
wished to continue with the DoD-sponsored DAT program, and 
a few indicated they would like to use ASVAB, 

Recruiting districts were split in their reactions to 
the PsyCor/DAT pilot; some wished to discontinue it com- 
pletely; others wished to expand the effort. The reported 
problems included a perceived lack of communication with 
the contractor at the local Level, and the delayed receipt 
of student results and leads®. Most recruiters were said 



^N.B,; (1) Communications between the DRC and the 
contractor were neither expected nor encouraged by USAREC 
Headquarters personnel. (2) PsyCor mailed Student Results 
to the address designated by each Service, Any delay in 
receipt by the field recruiter would be expected to have 
resulted from handling procedures within the Service. 
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to feel that the additional information in each lead was 
very helpful and made telephonic contact more comfortable, 
"but it did not seem to translate into contracts." 

One participating DRC which experienced some negative 
results from the pilot reported that ^ "most area commanders 
feel that the schools that were chosen did not have a 
priority that deserved any detailed attention. Another DRC 
commented on "three positive items: the test is shorter 
f sic 1 than the ASVAB, it appears to prequalify the indi- 
vidual, and permits parents and counselors to express their 
views." 



The information contained on the results 
sheets was considered extremely valuable 
by the field recruiter. Recruiters felt 
they had a real handle on the prospect and 
his/her parents, and was f sic i able to 
start effective telephone conversations 
which resulted in appointments. The pre- 
dicted AFQT seemed to be fairly accurate. 
Recruiters felt comfortable with the idea 
that the students wanted to hear from them. 

when summarizing district reports on the New England 
pilot project, USAREC commented: 

Commercial testing through the Psycho- 
logical Corporation seems to have been 
less than a resounding success due to 
the low numbers tested [,] and that testing 
was essentially done in schools that had 
a low priority to the recruiting force. 

The testing did not, apparently, have an 
appreciable effect on turning the situation 
around in New England, at least in terms of 
generating increased access to difficult 
schools or generating contracts. That it 
provided leads not previously available is 
true, but those leads were not converted 
into contracts. 

Some specific recommendations from the districts 
included: "If the program were to continue, DRCs should 

have more input and control over which institutions are 
approached to participate," "The [DRC] recommends that the 
program be expanded," "Results Sheets must be returned to 
each Service at the same time," 

These comments from the field suggested an incomplete 
flow of information about: the DAT pilot project, the roles 
of the various participants, and the fact that school 
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selection was almost entirely dependent upon MEPCOM and IRC 
choice. While such confusion is not unexpected in a large 
and complex organization such as the Department of Defense, 
these factors may well have affected the effort expended 
in working with leads and in reporting outcomes attribu- 
table to the pilot testing. 

USAREC also expressed some concern about the degree 
of cost-effectiveness of the commercial testing program, 
when measured strictly in terms of contracts resulting from 
the pilots. However, the initial purposes of expanding the 
Service presence into schools not participating in student 
ASVAB testing, and of bringing military training and edu- 
cation programs to the attention of higher-ability students 
have to figure into the equation. 

3. Air Force 

The Air Force commented only about the ACT portion of 
the commercial testing project. Their response was 
positive, but pointed out that 

the current favorable recruiting environment 
makes comprehensive evaluation of commercial 
testing difficult, particularly when attempt- 
ing to measure new contracts which resulted 
from this program. However, our decision to 
continue funding the program in FY84 is indic- 
ative of our positive reaction to this ini- 
tial effort. We believe the increased recep- 
tiveness of participating schools to military 
recruiters .. .will provide long-term dividends 
as the economy improves and recruiting becomes 
more difficult (Keesling, 27 October 1983). 

The reactions of participating schools also were 
reported to be favorable: 74 percent were more receptive 

to information about the military; and 37 percent were more 
interested in ASVAB use. On the other hand, however, 63 
percent of the schools were reported to be less interested 
in using ASVAB. 

When presented with three options, 87 percent were 
said to prefer commercial tests to ASVAB, while 13 percent 
preferred DoD-sponsored commercial tests in combination 
with ASVAB. None of the schools indicated a preference for 
the elimination of DoD student testing. 

When the recruiting squadrons were surveyed for their 
reactions to the commercial testing program and its future. 



47 



7 9 percent found the pilot valuable, and 71 percent said 
it should definitely be continued. Their responses are 
presented in Table 14. 



TABLE 14 

DSAF RECRDITIHG SQUADRON REACTIONS TO 
THE COMMERCIAL TESTING PILOT 
(PERCENTAGE OP RESPONSE) 



Value to Recruiting 



Extremely 


Somewhat 


No 


Somewhat 


Extremely 


Valuable 


Valuable 


Opinion 


Worthless 


Worthless 


58 


21 


17 


0 


4 



Fyityre (Jgg 
Definitely 


Probably 


No 


Prob. Not 


Def. Not 


Continue 


Continue 


Opinion 


Continue 


Continue 


71 


12 


4 


8 


4 



In addition. Air Force noted that leads from the 
commercial test were received when civilian jobs (espe- 
cially in Michigan where the majority of the Air Force- 
sponsored testing occurred) were extremely scarce and 
the military recruiting environment was quite favorable. 
They pointed out that the value of the CPP leads could not 
be measured accurately under such conditions, but would be 
more apparent during difficult recruiting times. 

When considering future use of commercial testing as 
a supplement to the DoD high school program, the Air Force 
found the lack of student telephone numbers on the 
recruiter report to be a serious limitation. This was 
subsequently identified as one of the changes to be 
incorporated into the 1983-84 continuation of the supple- 
mental pilot program, 

4. Navy 

Although not a sponsor of the ACT Career Planning 
Program pilot project, the Navy provided some survey 
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information (Lindahl, 1983) by school and by state. Navy 
Recruiting Districts (NRDs) reported that 77 percent of the 
schools participating in the CPP pilot showed no change in 
their interest in the student ASVAB. Eight percent 
indicated more interest, while 15 percent were less inter- 
ested in ASVAB. 

The interest in ASVAB reported for the New England 
pilot was quite similar. NRD reports for the PsyCor pilot 
showed 88 percent of the schools were unchanged in their 
interest in using the student ASVAB. Another 5 percent 
showed more interest, and the remaining 7 percent were said 
to be less interested in using the DoD aptitude battery. 
Table 15 summarizes these reactions for the two pilots. 



TABLE 15 

NAVT SURVEY OP ASVAB INTEREST AMONG SCHOOLS 
IN THE CPP AND DAT PILOT PROJECTS 

(NUHBER/PERCENTA6E OF SCHOOLS) 



Interest in A g VA P 



Pilot 


Schools 

Surveyed 


More 


No Chanqe 


Less 


ACT/CPP 


270 


22/8 


207/77 


41/15 


PsyCor/DAT 


43 


2/5 


38/88 


3/7 



In addition. Navy districts indicated the preferences 
of the participating schools if offered a range of options 
for Defense-sponsored testing: a commercial aptitude test, 
student ASVAB, both a commercial aptitude test and student 
ASVAB, or no Defense testing. They reported (Table 16) 
about equal responses in each of the four categories among 
schools in the CPP pilot. There was, however, a slightly 
greater preference expressed for the DoD-sponsored com- 
mercial aptitude test, used either alone or in combination 
with the student ASVAB. Among New England schools 
surveyed, the use of a commercial instrument was clearly 
favored. 
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TABLE 16 



NAVY SURVEY OF DEFENSE TESTING PREFERENCE AMONG SCHOOLS 
PARTICIPATING IN THE CPP AND DAT PILOTS 

(NDNBER/PERCENTAGE OF SCHOOLS) 



Pilot 



P , r e. ferre<l 

Schools 

Surveyed Cominercial Both AgVAB 



No Defense 
Testing Wanted 



ACT/CPP 258 
PsyCor/DAT 43 



70/27 69/27 63/24 

32/74 6/14 0 



56/22 

5/12 



Efforts to provide leads to higher-ability students 
are intended ultimately to improve the "quality" of indi- 
viduals entering the Services. Although it has proven 
difficult to determine what percentage of students who take 
the ASVAB in high school actually do enter the military 
within two years, some steps have been taken in that 
direction (Lee, 1979; Lee et al., 1982), To assist in 
studying the process for other Defense-sponsored instru- 
ments, the Navy provided totals of seniors who had 
contracted to enlist from schools participating in the 
commercial aptitude pilot projects. 

The number of graduating seniors contracting to enlist 
in the Navy, from the 281 ACT/CPP pilot schools for which 
reports were provided, increased by 13 percent for 1983. 
These seniors, the class of 1983, represented juniors 
tested with the CPP in the Spring of 1982. It appeared 
that, for all locations involved in the CPP pilot except 
Iowa, the participating schools became more productive for 
Navy recruiters during the pilot program, even though no 
direct leads were to have been made available to Navy 
representatives . 

In contrast, the number of New England seniors 
contracted for Navy declined appreciably for FY 1983, in 
the 43 DAT pilot schools for which reports were provided. 
The NRDs reported contracting fewer than half as many 
seniors in these schools as they had in the previous two 
years. The reason for the overall decline in reported 
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contracts was unknown^. The Navy report showed that in 
several instances contracts had been written in a partici- 
pating school; although a like or larger number of appoint- 
ments had been scheduled as a result of the commercial test 
leads, no contracts were credited to the commercial pilot. 
Table 17 shows the numbers of contracts written for seniors 
in the participating schools, by fiscal year. 



TABLE 17 

NAV7 REPORT OF SENIORS ENLISTING PROM CPP- AND 
DAT-PARTICIPATING SCHOOLS BY FISCAL TEAR 



Pilot 


Schools 

Surveyed 


Number of 
FY81 


SeniQ-LS.. 

FY82 


-ContLa.c..t£.d 

FY83 


ACT/CPP 


281 


353 


353 


398 


PsyCor/DAT 


43 


88 


89 


43 



Several hypotheses might be advanced for the increase 
in Navy contracts reported for schools participating in the 
ACT/CPP pilot. For example, because of the sluggish 
economy. Navy might have done better in all schools in 
those districts during this time period, regardless of the 
experimental program. Or, Navy recruiters might have 
"tried harder" in those schools, feeling that the supple- 
mental testing sponsored by another Service might otherwise 
put them at a disadvantage in the marketplace. Perhaps 
a "halo effect" allowed all the Services to benefit from 
having military training and educational programs brought 
to the attention of students through the career exploration 
experience of the CPP. Or, some entirely different local 
factors might have been operating in these instances. 

Overall, the Navy Recruiting Command did not consider 
"...pilot program results sufficiently conclusive thus far 



^Personal communication with Headquarters, Navy 
Recruiting Command, 21 December 1983, indicated that the 
reported numbers were to be treated as end-of-year data. 
The NRDs were required to provide reports to their Head- 
quarters by 1 August 1983. 
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to permit substantive appraisal of the program as a 
prospect-qualifying or lead-generating device (Lindahl, 
1983)." The Navy recommendation was to wait for results of 
the 1983-84 pilot effort, then to review the commercial 
testing program. 

The Navy expressed concern that inc r easing 
acceptance of and apparent preference for the commercial 
test by user schools may hinder ASVAB marketing initiatives 
once more schools are aware of the supplementary program's 
existence (Lindahl, 1983)." 

5. Marine Corps 

The Marine Corps acted as an interested observer to 
the 1982-83 Career Planning Program pilot and, like the 
Navy, provided the numbers of senior students contracted 
for Marine Corps enlistment in participating schools during 
fiscal years 1981 through 1983, A similar report was 
provided for the New England schools participating in the 
DAT pilot. The data were complete for FY 1983 (Lindahl, 
1983) . 

Seniors contracted for the Marines, in the 302 ACT 
pilot schools for which data were reported, increased by 
30.1 percent in 1982. For 1983, the increase was an addi- 
tional 13.5 percent. Suggested reasons for the improved 
recruiting in these schools would resemble those discussed 
for the Navy, In the New England pilot, however, a report 
on 25 of the 40 participating schools showed an increase in 
FY 1982 followed by a decline for FY 1983 (Table 18) , 



TABLE 18 

MARINE CORPS REPORT OP SENIORS ENLISTING PROM CPP- 
AND DAT-PARTICIPATIN6 SCHOOLS BY PISCAL YEAR 







Number of 


Seniors 


Contracted 


Pilot 


Schools 

Surveyed 


FY81 


FY82 


FY83 


ACT/CPP 


302 


215 


289 


328 


PsyCor/DAT 


25 


25 


29 


24 



52 



The Marine Corps concurred with the Navy Recruiting 
Command position that the results of the pilot program to 
date did not permit a final evaluation to be made of its 
value for generating leads or qualifying prospects. The 
Marine Corps, however, did join the Air Force and Army in 
supporting continuation of the ACT Career Planning Program 
project, 

6. MEPCOM 

The Military Entrance Processing Command provided 
information about ASVAB testing in schools participating in 
the pilot program (Zaldo, 8 March 1983), as well as a 
summary of comments received from the relevant Military 
Entrance Processing Stations about school reactions and any 
impact on the student ASVAB (Zaldo, 21 October 1983) , The 
MEPS comments were reported in question and answer format, 

Q: Are schools more receptive to information 

about the military as a career option as a 
result of the commercial testing program? 

A: Schools seem to be evenly divided on receiving 

military information. Some want to receive 
this information, others could f sic l care less. 
Students appear to be more receptive after 
taking the commercial test; however, it is not 
known if it is because of the test or economic 
conditions at this time. 

Q; Are schools more or less interested in using the 
ASVAB after using the commercial instrument? 

A; Schools are less interested in using the ASVAB 
after using the commercial test. 

MEPCOM was concerned that administration of a Defense- 
sponsored commercial test would have a negative impact on 
the student ASVAB testing program. The MEPSs also were 
tasked to respond to several questions bearing on that 
concern. 

Q. Has the administration of this commercial 
instrument caused any turbulence in MEPS 
areas of responsibility that has had any 
detrimental impact on ASVAB testing? 

A. Most MEPSs feel that the commercial 

instrument has had some adverse affect 
on its f sic l ASVAB programs. It has 
become more difficult to promote the 
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ASVAB in those schools that took the 
commercial test, 

Q, Have any schools in MBPS areas of respon- 
sibility cancelled ASVAB testing because 
the commercial instrument was not offered 
to them? 

A. No schools have cancelled ASVAB testing be- 
cause they have not been offered the com- 
mercial test. Several schools have threat- 
ened cancellation because other schools in 
its f sic i school district were offered the 
test and they were not, MBPS personnel 
and recruiters were able to overcome this 
threat and administer the ASVAB as 
scheduled. 

In addition, the MBPSs were queried about any schools 
which declined to schedule ASVAB testing because they had 
not been offered the commercial test. No such instances 
were reported. 

In view of recruiting command reports of schools 
scheduling ASVAB as a result of participation in the 
commercial testing pilot program, and MBPS reports that 
schools were less interested in the student ASVAB after 
using the commercial test, it was helpful to have school 
testing information provided by MBPCOM, Data on actual 
participation in the ASVAB student testing program shed 
some light on trends in these schools. 

In comparing numbers of students tested during school 
years 1981-82 and 1982-83, the two years for which data 
were available for all of the participating schools, MBPCOM 
reported (Table 19) a slight overall increase in ASVAB 
usage in CPP-part icipating schools. Testing data for SY 
1982-83 were complete as of February 1983, Additional 
testing may have occurred during the Spring phase of the 
student ASVAB program, 

MBPCOM also provided information about ASVAB testing 
in schools participating in the New Bngland pilot program 
[B, B, Gerding, letter to W, S, Sellman, OASD(MI&L), 1 
December 1983; Zaldo, 8 March 1983], Since reports from 
the Services and the MBPSs tended to suggest that New 
Bngland schools participating in the pilot program were 
generally unchanged in their interest toward using ASVAB, 
the student ASVAB testing data (through February 1983) 
shown in Table 20 were interesting. 
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TABLE 19 



HBPCOH REPORTED STUDENT ASVAB ACTIVITY IN 
SCHOOLS PARTICIPATING IN ACT/CPP PILOT 





Number of 




Number of 


Students 


State 


Hiah Schools 




SY 1981-82 


SY 1982-83 


California 


25 




595 


462 


Indiana 


14 




1 


284 


Iowa 


44 




64 


101 


Michigan 


102 




2211 


2056 


Minnesota 


65 




751 


717 


Ohio 


19 




8 


3 


Oregon 


8 




173 


85 


Washington 


14 




129 


147 


Wisconsin 


1 _ 




s. 




Total 


293 




3932 


3975 


Despite the 


selection for 


the 


pilot projects of non- 


ASVAB-using schools, there was 


an 


increase in 


the numbers 


of students tested with ASVAB from 


School Years 


1981-82 to 


1982-83, The increase from 22 


to 


264 students 


tested was 


significant, with 


most of the additional testing occurring 


in Massachusetts. 












TABLE 
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MBPCOM REPORTED STUDENT 


ASVAB ACTIVITY 


IN 


SCHOOLS PARTICIPATING IN DAT PILOT 






Number of 




Number of 


Students 


State 


Hiah Schools 




SY 1981-82 


SY 1982-83 


Connecticut 


8 




0 


17 


Maine 


6 




0 


5 


Massachusetts 


20 




22 


242 


New Hampshire 


1 




0 


0 


Rhode Island 


4 




0 


0 


Vermont 


__ 1 _ 









Total 


40 




22 


264 
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MEPCOM concluded that the commercial testing program 
had merit, but "should be evaluated by a disinterested 
outside civilian agency for recommendations on how to 
proceed with such a program (Zaldo, 21 October 1983)." 

7. Service Overview 

The comments from the military commands offered both 
commonalities and differences. They were summarized 
briefly to indicate the complexities inherent in both the 
operation and evaluation of the pilot programs. 

MEPCOM reported that the schools were "evenly divided" 
in their interest in military information after using the 
DoD-sponsored commercial test. This differed from the Air 
Force finding that 74 percent of the schools were more 
receptive. Both MEPCOM and Air Force were in agreement, 
however, that interest in using the student ASVAB declined 
after using the commercial instrument (Air Force: 63 
percent less interested). Navy, in contrast, had found the 
majority of schools (77 percent) unchanged in their 
attitudes toward ASVAB, with only 8 percent showing more 
interest, and 15 percent less interest in the Defense test. 

On the question of preferring the commercial test to 
ASVAB, MEPCOM found the schools divided, as had Navy (24 
percent ASVAB, 27 percent commercial); Air Force, however, 
had reported that 87 percent preferred the commercial 
test. If offered both a DoD-sponsored commercial test and 
ASVAB, MEPCOM reported, "The majority of schools contacted 
would not consider using bo t h . . . b ec au s e of time 
constraints." This was supported by both Air Force (only 
13 percent preferred both tests) and Navy (27 percent) 
findings. The context in which this question was answered 
was not clear, but it apparently was construed to mean "use 
both tests in the same school year," and probably with the 
same students each time. 

MEPCOM reported that, even if offered the option of 
having no Defense testing, most of the schools queried 
would not want to eliminate DoD-sponsored tests from their 
testing programs. Again, the Service reports were in 
agreement, with approximately one-fifth or fewer of the 
schools preferring no Defense tests (Air Force: 0; Navy: 
22 percent) . 

In addition to the comments and recommendations 
reported above from the recruiting field force, one 
district suggested that: "...program directives [should] 
specify that the military services are options which should 
be considered in the career exploration process." This 
step was, in fact, a consideration in planning for the 
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1983-84 continuation of the pilot program, in the expec- 
tation of ensuring that all participants were exposed to 
military opportunities early in the testing process. 
Another comment (Zaldo, 21 October 1983) would have found 
support in several of the Services: 

In order to expose the widest range of 
students to military opportunities, all 
students taking the test must agree prior 
to test administration that they will 
release their names to the armed forces 
for contact purposes or they will not be 
tested. The school must also agree to 
this stipulation or they will be excluded 
from the program. 

This recommendation overlooked three relevant consid- 
erations; (1) no such restriction had been placed on 
schools participating in ASVAB testing (in accordance with 
the 1976 Finneran-Mosher agreement that DoD would not 
attempt to make ASVAB mandatory) , (2) it was uncertain 

whether any school would agree to levy such a requirement 
on its students, and (3) students who chose absence over 
forced testing would not be exposed to either the "military 
as a career choice" orientation or the DoD questionnaire. 
As reported earlier, the "mandatory" DAT testing had 
produced a maximum of 90-95 percent attendance, even though 
the student could choose whether or not to release infor- 
mation; it also produced some parental concerns about 
ethics and legality. 

Concern was expressed about the student release 
options by another recruiting district. It was recommended 
that the option of requesting information from the testing 
organization be eliminated, since it "only reduces the 
amount of good leads." This comment about leads being 
reduced because of the indirect option is debatable; one 
might also hypothesize that every student choosing the 
indirect option would refuse to receive any military 
information if that choice were not available. 

For two schools reported by Army to have cancelled 
ASVAB after being offered the DoD-sponsored DAT, the Navy 
found no change in ASVAB interest. One of the schools, 
which had tested four students with ASVAB, was reported to 
prefer the commercial test to ASVAB. The second school, 
which had used ASVAB to test only 31 and 22 students in the 
previous two years, was said to prefer both ASVAB and the 
commercial test. These differing reports suggested some- 
thing of the complexities facing Service representatives at 
the IRC level. 
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D 



PROGRAM COSTS 



To address the issue of program cost, a comparison was 
made of various expenses associated with both supplemental 
testing and the student ASVAB, Total expenditures for the 
ACT/CPP pilot were readily available; data for the student 
ASVAB were provided by HumRRO, which had collected cost 
figures from MEPCOM as part of the evaluation of the 
Centralized Marketing Pilot Program (Schneider et al., 
1984) . (Because the number of students tested in New 
England was far below the goal, realistically comparable 
cost figures from the PsyCor pilot were not available.) 

The funding for the CPP pilot had been based on a set 
cost per test, which included; complete pre-test, scoring, 
and post-test materials and services to the schools; 
delivery of student reports to recruiters; delivery of 
military information to students; survey of school and 
student reactions; monthly progress reports; and the final 
report summarizing and evaluating the project. Thus, it 
was possible to determine the costs per test and per lead 
for the pilot program; it was expected that costs would 
decrease as the numbers of students tested increased. 

With the student ASVAB, however, determining compar- 
able costs was somewhat more complicated. MEPCOM had pro- 
vided cost figures to HumRRO which included: test mater- 
ials and research, test administration, and both MEPS and 
Office of Personnel Management testing. Other student 
ASVAB program costs were not included, such as the expenses 
of developing test or promotional materials, and shipping 
them to the MEPSs and recruiting commands. Some additional 
items included in the overall MEPCOM budget provided 
support to the student testing program without being 
specifically identified for that program. 

These costs were believed by MEPCOM and HumRRO to be 
minimum estimates of the total cost of the student ASVAB 
program, since only directly attributable items were 
included. The costs of recruiting command military and 
civilian support during the ASVAB marketing, administration 
(test proctors), and score interpretation phases would not 
be reflected in the MEPCOM budget. Such costs to the 
recruiting commands occur routinely in support of the 
student ASVAB, but would not be necessary to support DoD- 
sponsored commercial aptitude testing. 

Student ASVAB costs were reported separately for 
school years 1982-83 and 1983-84, and for both the central- 
ized marketing MEPSs and a HumRRO-matched group of control 
MEPSs (Appendix D) . The data reported for SY 1982-83 
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included publication costs for ASVAB testing and marketing 
materials. Because these were not annual costs, and 
because the figures varied between the groups of MEPSs, 
only approximate costs per test and per lead could be 
estimated. 

It appeared that the cost for each test administered 
to a junior or senior was slightly lower for the CPP than 
for the student ASVAB. The cost per lead was lower for the 
student ASVAB, while the cost for each "quality" lead 
(students scoring in Categories I-IIIA who expressed 
interest in the military or were undecided about their 
future plans) was about twice as high for ASVAB as for the 
commercial test. 



B. IMPACT ON STUDENT ASVAB TESTING PROGRAM 



While some concerns had been expressed about a poten- 
tially negative effect on the student ASVAB program in the 
commercial testing pilot locations, such effects appeared 
to have been confined to particular schools or MEPSs. 
Overall, the Army had reported that some schools were 
encouraged by their participation in the commercial pilots 
to schedule their first student ASVAB testing. The Navy 
had reported very little change in ASVAB interest among the 
schools participating in the pilots. Their survey of the 
CPP pilot schools showed about equal preferences for the 
use of ASVAB, or the commercial test, or both. A slightly 
smaller segment of the schools preferred no DoD testing at 
all. In New England, however. Navy reported a significant 
preference for the commercial test. Since these schools 
consistently had declined to use the student ASVAB, this 
preference was not surprising. 

Some discrepancies were evident in the ASVAB interest 
reported for two specific schools by different Services. 
This exemplified the difficulties inherent in determining 
a school's position when different military representatives 
may have been working with different school officials.® 

Most MEPSs were reported to believe that the commer- 
cial pilots had adversely affected the student ASVAB 
program. They referred to some situations in which a 
school had "threatened cancellation" of ASVAB because other 
schools in the district had been offered the commercial 



p I 

°This situation also may have dramatized the diffi- 
culties inherent in obtaining survey information from 
the field. 



59 



test and that particular school had not, HEPS personnel 
and recruiters were able to intervene and administer ASVAB 
as scheduled. 

MEPCOM testing data confirmed an overall increase in 
student ASVAB activity in the pilot schools. Although 
declines were noted in some of the schools, the total 
testing increased in both the CPP and the DAT pilot areas. 
Since the testing data provided for SY 1982-83 were not 
updated after February (Zaldo, 21 October 1983), the final 
totals of students tested with ASVAB in the commercial 
pilot schools last year were not known. The annual MEPCOM 
Spring effort to schedule additional student ASVAB testing 
may have increased the numbers tested in the commercial 
pilot schools. 

While some difficulties were reported in promoting 
ASVAB to schools participating in the commercial pilot 
programs, it must be remembered that most of these schools 
had been selected specifically because of nonparticipation 
in the student ASVAB program. Although a decline in 
testing was reported by some MEPSs, a slight overall 
increase in the student ASVAB program occurred in schools 
participating in the supplemental commercial testing pilot. 

Chapter VI will summarize the efforts to offer commer- 
cial aptitude testing in the DoD Student Testing Program, 
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VI 



SDHHARY AMD RBCOHHENDATIOHS 



The Defense student testing program was developed to 
provide leads to junior and senior students qualified for 
military training, while also offering a career guidance 
instrument for use in the nation's high schools and post- 
secondary institutions. The student ASVAB had consistently 
reached only about 12 percent of those high school juniors 
and seniors, with the majority of test-takers achieving 
below-average ability levels. Methods were explored for 
supplementing the program with commercial aptitude instru- 
ments to expand the awareness of higher-ability students to 
training and educational opportunities in the military. 

After an initial exploration of the concept of Defense 
subsidization of a commercial test, HumRRO (under a joint 
MEPCOM-USAREC contract) found that the schools, students, 
recruiters, and the testing organization were favorably 
disposed toward the effort. Therefore, a dual project was 
undertaken in 1982-1983. One pilot, sponsored by the Army 
Recruiting Command and the Air Force Recruiting Service, 
used the American College Testing Program (ACT) Career 
Planning Program (CPP) in the Midwest and West. The second 
pilot used The Psychological Corporation's (PsyCor) Differ- 
ential Aptitude Tests (DAT) in New England, and was spon- 
sored by DoD on behalf of all Services. 

The commercial test was offered to schools that were 
primarily non-ASVAB users, a group expected to be less 
inclined to cooperate with a DoD program than randomly 
chosen schools would have been. Despite the challenges 
posed by the school selection process, the CPP pilot 
succeeded in testing over 48,000 students in more than 300 
high schools. The DAT pilot tested just over 6800 students 
in 40 New England schools. 

The schools invited to participate in the CPP pilot 
were receptive to the concept of Defense sponsorship. The 
reason given most often for nonparticipation was "short 
notice" to plan for and fulfill their responsibilities as 
participants. One student in four reported an increased 
awareness of DoD opportunities as a result of the testing 
experience. This response was of interest because the 
survey was taken before the students had received either 
direct contact from a recruiter or Service literature 
provided through the mail by ACT. 
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In New England, the invited schools were not as recep- 
tive to the pilot concept. For the nonparticipants who 
replied and gave a reason, "lack of testing time" was cited 
most frequently. PsyCor did not provide additional survey 
responses for either school officials or students. 

The students tested in the CPP pilot represented a 
cross-section of ability levels, with about 57 percent 
scoring above the mean. The PsyCor pilot in New England, 
on the other hand, tested students with above-average 
ability levels. About 73 percent were estimated to be in 
AFQT Categories I-IIIA, in a group with high private and 
parochial school representation. 

Male students were more likely to request either 
direct or mail contact with the sponsoring Service(s). 
Both male and female students in the New England pilot 
appeared somewhat more receptive to receiving military 
information than their counterparts in the Midwest and 
West . 



The only publicity known to have arisen from the 
commercial testing pilot projects originated with one 
Massachusetts school. After an initial adverse reaction in 
the local press, the question of Defense sponsorship of a 
commercial aptitude test was referred to the American 
Psychological Association and also to the American School 
Board Association. Both concluded (in articles with 
nationwide audiences) that there was no ethical conflict in 
such sponsorship, since the DoD role was clearly stated, 
and students had the option of not providing information. 
Some positive statements were made about the ACT approach 
to the pilot concept, in which the schools had been encour- 
aged to involve parents in the testing experience. 

Air Force and Army recruiters found the supplemental 
testing valuable and wanted it to continue. MEPCOM and Air 
Force surveys reported between 50 and 74 percent of the 
participating schools were more receptive to information 
about the military. The Air Force reported that 10.5 
percent of the students who had requested additional infor- 
mation by mail returned the business reply cards, thus 
becoming direct leads. This contrasted with a return rate 
of 2.4 percent to the four Services from the New England 
pilot. 



The Army expressed concern about the cost-effective- 
ness of the supplemental testing program. When compar- 
isons were made with the most current information available 
about student ASVAB costs, it appeared that the cost for 
each test and quality lead were lower with the commercial 
instrument. The costs for student ASVAB were based on 
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estimates believed to be low, and which did not include 
any recruiting command contributions to the program. 

Efforts to link Defense student testing to subsequent 
accessions have proven difficult, although measures could 
be developed over time for supplemental commercial testing 
as they have been for the student ASVAB, The Navy and 
Marine Corps reports of seniors contracted through FY 1983 
in schools participating in the two commercial aptitude 
testing pilot projects provided a first step toward 
measuring that relationship for a supplemental test. 
Further attention must be directed toward enlistments from 
the graduating classes of 1983 and 1984 in schools that 
offered the Defense-sponsored CPP and DAT. 

The overall impact on the student ASVAB was perceived 
to be somewhat negative by the Military Entrance Processing 
Stations in the commercial aptitude testing pilot areas. 
Reports from the Services, however, had indicated some new 
ASVAB scheduling among schools participating in the pilot 
projects. Data provided by MEPCOM confirmed a slight 
increase in total ASVAB testing for participants in both 
the CPP and the DAT pilots, with declines reported for some 
of the schools. 

Experimental efforts to supplement the Defense student 
testing program with commercial aptitude tests were appar- 
ently successful in achieving the goals of: providing 
higher ability leads to recruiters, enhancing the image of 
the Defense student testing program, increasing the 
cooperation shown to recruiters in the participating 
schools, and increasing student awareness of military 
opportunities solely as a result of taking the test. In 
addition, recruiters were provided with leads that not only 
introduced students who had actively expressed an interest 
in learning more about the Service(s), but also provided a 
comfortable starting point for initiating contacts with 
those students. This was accomplished at a cost apparently 
lower than that of the student ASVAB. Additionally, the 
commercial testing required no investment of recruiter time 
until the leads were received. 

The pilot programs also fulfilled the intended purpose 
of revealing weak points or problem areas in either the 
concept or its execution. Several of these were relatively 
minor, and were improved upon during planning for the 1983- 
84 continuation of the ACT/CPP pilot program. Others were 
more complex, and will require some additional time, 
communication, and cooperation before a solution can be 
reached. 
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An evaluation of the 1982-1983 pilot programs to 
supplement the student ASVAB with commercial aptitude tests 
does not lead directly to a recommendation about the 
immediate future of the concept. Rather, it leads to a 
discussion of modifications recommended for the continu- 
ation of the pilot effort. It is from the evaluation of 
supplemental aptitude testing through the 1984 school year 
that recommendations may be offered for any future imple- 
mentation of DoD-sponsored commercial testing. 

Recruiter concerns about the "low priority" of the 
schools selected for the 1982-1983 pilots had prompted a 
recommendation that the selection criteria be expanded. 
Accordingly, schools which had used ASVAB with only a small 
percentage of their juniors and seniors (e.g., 5 percent) 
were to be included in the sample with the non-ASVAB-users 
previously identified. 

The absence of a student telephone number had been 
identified as a weakness in the student report released to 
recruiters. It was recommended that discussions be opened 
with ACT about modifying the CPP student answer form to 
permit capturing this information for 1983-1984. 

The order of the release items on the DoD question- 
naire appeared to affect student willingness to be con- 
tacted directly by Service representatives. The direct 
contact option had been selected more frequently when it 
was in the first position, and this placement was recom- 
mended. 

Lack of information at the local level (Interservice 
Recruitment Committee: the recruiting districts/squadrons 
and the MEPSs) had been cited as a detriment to the pilot 
projects and to the student ASVAB testing program. 
Immediate efforts were undertaken to inform the various 
Service and MEPCOM headquarters regularly about the status 
of supplemental aptitude testing, and it was recommended 
that the information be passed on to all IRC members con- 
cerned with the pilot testing efforts. 

In conjunction with the previous recommendation, it 
must be noted that the "local confusion" reported from the 
IRC-level can inspire misconceptions and apprehensions 
which are communicated to the educational community. The 
use of commercial aptitude tests to supplement the student 
ASVAB program, the introduction of a new version of ASVAB 
for SY 1984-85, and the proposed use of a commercial 
interest inventory in conjunction with that new form (as 
recommended by the Defense Advisory Committee on Military 
Personnel Testing), all combine to raise questions about 
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the "Defense Student Testing Program" among educators as 
well as within DoD. 

In the spirit of both defining and refining Defense 
efforts, it is suggested that careful consideration be 
given to the role and purpose(s) of the Defense student 
testing program. The time appears right to reconsider some 
old questions, and to ask some new ones: 

--What is the purpose of the DoD student testing 
program? 

— to supply pre-qualif ied leads to recruiters? 

-- to provide a service to the schools and 
students? 

— to provide access to high schools for military 
recruiters? 

-- to increase student awareness about opportu- 
nities for training and education in the 
Services? 

--What percentage of juniors and seniors must be 
tested annually for the DoD student testing 
program to serve its intended purpose (s)? 

— Is the average ability level of the students tested 
of concern in fulfilling the purpose(s) of the 
DoD student testing program? 

— If the recruiting commands were not called upon 
to fund supplemental testing directly, would 
they object to having the DoD student testing 
program include one or more commercial tests in 
addition to ASVAB? 

--What changes, if any, would be necessary within 
MEPCOM in order to accommodate broader responsi- 
bilities for student testing? 

These questions suggest the range of concerns which 
deserve attention, and by no means exhaust the possi- 
bilities. If there is a compelling reason for the exis- 
tence of a DoD student testing program, that reason must 
include a consideration of the needs of the schools, the 
students, and the field recruiters. In the initial pilots, 
the participating schools spoke affirmatively on the 
question of a Defense-sponsored commercial aptitude test. 
Recruiters who used the leads found them valuable. It 
remains to be determined whether the benefits are great 
enough to warrant continuation and expansion of the effort. 
Cost also must be a consideration, whether the DoD student 
testing program were to consist of the ASVAB, a subsidized 
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coimnercial aptitude battery, or a combination of these or 
other instruments. 

The final evaluation of efforts to supplement the 
Defense student testing program with commercial aptitude 
tests through School Year 1984 will require a careful 
consideration of: the demonstrated contributions of a 
subsidized commercial aptitude test, the effects of imple- 
menting modifications recommended for 1984, the needs of 
the recruiting commands and of the schools, and the overall 
costs and benefits of such a program. 
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APPENDIX A 



SaiDple Student Questionnaires, DOD-Sponsored 
Commercial Aptitude Testing Pilot Projects 



1. Sacramento, Ca, Pilot Project, 

Spring 1981 71 

2. American College Testing Pilot, 

Spring 1982 75 

3. Psychological Corporation Pilot, 

Pall 1982 and Spring 1983 79 
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Sacramento, CA, Pilot Project 
Spring 1981 



ITEMS FOR UNIT »10 OF CPP 



Funding the Career Planning Program as part of your 
school's guidance service has been provided all or in part 
by the Department of Defense. The purpose is to help you 
expand and strengthen your career and educational planning 
and to offer you the opportunity to become better 
acquainted with the educational and vocational opportun- 
ities available through a period of military service. 

The Department of Defense offers a broad variety of educa- 
tional and vocational training programs which help many 
young people develop their skills. These include programs 
that can lead to employment and, in some cases, to large 
educational benefits after completing two years or more of 
military service. ACT is willing to aid the communication 
between you and the Department of Defense but will do so 
only according to your instructions. 

The following questions have been developed by the Depart- 
ment of Defense (DoD) and are being asked for the following 
reasons: 

1. To get you thinking abut some of the things 
that a tour of military service can provide. 

2. To match your personal needs and wants with 
DoD opportunities, so that if you are 
interested, you can receive information 
about how DoD can help you meet them. 

Please mark each of your answers in the Unit #10 section of 
your Career Planning Program answer folder. 

1. Do you wish ACT to inform you about the Department of 
Defense's educational and vocational programs and 
benefits? (Answering yes to this item means this 
information will be sent to you in the mail; your 
name and CPP information will not be released to 
the Department of Defense) . 

A. Yes 

B. No 
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ITEMS FOR UNIT #10 OF CPP 



2, Do you wish ACT to send your CPP record to the Depart- 
ment of Defense so that Defense can contact you 
directly about programs and opportunities that are 
related to your needs and goals? (Answering yes to 
this item means that your name and CPP information 
will be released to the Department of Defense for this 
purpose) . 

A. Yes 

B. No 



3, How sure are you of your educational and/or vocational 
plans and goals? 

A, Very sure 

B, Fairly sure 

C, ^ Not sure 

4, How does availability of financial support affect your 
plans to continue your education? 

A, Intend to go on, finances not a problem 

B, Intend to go on but will have to find financial 
support 

C. Not going on because of lack of financial support 

D. Not continuing, but for other reasons 

5, Do you think you would benefit from a break in 
schooling before continuing on? 

A, Yes 

B. Undecided 

C. No 

D, Not planning to continue education 
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ITEMS FOR UNIT *10 OF CPP 



6. What are your chances of finding a good job after high 
school? 

A, Very good 

B, Fair 

C, Poor 

7. How important is it to you to develop better work 
habits and improve your self discipline? 

A, Very important 

B, Somewhat important 

C, Not important 

8. How important is it to develop a special occupational 
skill shortly after leaving high school, such as 
computer programming or auto maintenance? 

A. Very important 

B. Somewhat important 

C. Not important 

9. Read the following statements and decide how many are 
true about current conditions of military service. 

You can enlist for two or more years of active 
duty. 

If you qualify, you can select the training and 
occupation you want before entering military 
service. 

An enlisted person can take college courses while 
in service and can receive substantial funding 
for education and training after leaving service. 

Large bonuses are offered for enlistment in 
certain military occupations. 

The Department of Defense is one of the largest 
educational and training organizations in the 
world. 
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A. One is true 

B. Two are true 

C. Three are true 

D. Four are true 

E. All five are true 

10. What is your present level of interest in joining a 
military service for a few years or more after you 
finish high school? 

A, Very interested 

B, Somewhat interested 

C, Uncertain 

D, Somewhat disinterested 

E, Very disinterested 



11. If the Department of Defense were not providing funds 
for this special use of the Career Planning Program, 
it would not have been given at this time as part of 
your school's guidance service. What do you think 
about the Department of Defense providing support for 
this program? 

A. Good idea 

B. Don't care one way or the other 

C. Poor idea 

12. These questions were designed to get you thinking 
about military service opportunities and to make it 
possible for you to request information if you are 
interested. Do you feel positive or negative about 
answering these questions? 

A. Positive 

B. Negative 

C. Neither positive nor negative 
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American College Testing Pilot 
Spring 1982 

Questions for Unit 10 of the CPP 

Funding for the Career Planning Program as part of your school's 
guidance service has been provided all or in part by a branch of the 
Department of Defense. The purpose is to help you expand and strengthen 
your career and educational planning and to offer you the opportunity to 
become better acquainted with the educational and vocational opportun- 
ities available through a period of military service. 

The Department of Defense offers a broad variety of educational and 
vocational training programs which help many young people develop their 
skills. These include programs that can lead to employment and, in some 
cases, to large educational benefits after completing two years or more 
of military service. ACT is willing to aid the communication between 
you and the Department of Defense but will do so only according to your 
instructions. 

The following questions have been developed by the Department of Defense 
(DOD) and are being asked for the following reasons: 

0 To get you thinking about some of the things that a 
tour of military service can provide. 

0 To match your personal needs and wants with DOD 

opportunities, so that if you are interested, you 
can receive information about how DOD can help you 
meet them. 

Please mark each of your answers in Unit 10 section "Local items 
(Optional)" of your CPP answer folder. Although you may skip any 
question that you do not wish to answer, ACT can provide the most 
complete profile of you only if you answer every question. 

1 . Do you wish ACT to send your CPP record to the Army so that 
they can contact you directly about the programs and opportun- 
ities that are available in the Army? (Answering yes to this 
item means that your name and CPP Information will be released 
to the Army for this purpose eind an Army recruiter may contact 
you personally.) 

A. Yes 

B. No 
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2 



. Do you wish ACT to send you information about the Army's 
education and training programs and benefits? (Answering yes 
to this item means ACT will send information to you in the 
mail; your name and CPP information will not be released to 
the Army. ) 

A. Yes 

B. No 

3. How sure are you of your educational and/or vocational plems 
and goals? 

A. Very sure 

B. Fairly sure 

C. Not sure 

How does availability of financial support affect your plans 
to continue your education? 

A. Intend to go on, finances not a problem 

B. Intend to go on but will have to find financial support 

C. Not going on because of lack of financial support 

D. Not continuing, but for other reasons 

5. After high school, how easy or difficult do you think it will 
be for someone your age to find a fulltime job in your area? 

A. Almost Impossible 

B. Very difficult 

C. Somewhat difficult 

D. Not difficult 

E. Don't know 

6. Regarding your joining the military, would your parents be: 

A. In favor of your joining 

B. Against your joining 

C. Neutral 

D. . Don't know, haven't discussed it with them 
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7. Has your guidance counselor discussed military career oppor- 
tunities with you? 

A. Yes, has encouraged me to look Into the military 

B. Yes, has discouraged me from looking Into the military 

C. No, has not discussed this option with me 

8. Are any of your close friends or relatives currently serving 
In any brauich of the armed forces? 

A. Yes 

B. No 

9. Do you know that If your qualify, you can select the training 
and occupation you want before entering the military? 

A. Yes 

B. No 

10. Are you aware that Individuals can taike college courses while 
In the military and have 75$ of their tuition paid by the 
military? 

A. Yes 

B. No 

11. Do you have any history of physical problems other than routine 
childhood Illnesses? 

A. I have not had amy physical problems 

B. I have had physical problems, but not In the last year 

C. I currently have physical problems requiring a doctor’s 
care 
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12. What do you plan to do after you graduate from high school? 

A. Go to a 2-year college 

B. Go to a 4-year college 

C. Attend a vocational/technical school 

D. Get a job 

E. Join the military 

F . Other 

G. Undecided 
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Psychological Corporation Pilot 
Fall 1982 and Spring 1983 

Student Questionnaire 



General Information for the Student 

Funding for this testing with the Differential Aptitude 
Tests and Career Planning Program (DAT/CPP) as part of 
your school's guidance service has been provided by the 
Department of Defense. The purpose of the testing is to help 
you expand and strengthen your career and educational 
planning and to offer you the chance to become better ac- 
quainted with the educational and vocational opportunities 
available through a period of military service. 

The Department of Defense offers a broad variety of 
educational and vocational training programs that help 
many young people to develop their skills. These include 
programs that can lead to employment and, in some cases, to 
substantial educational benefits after completing two or 
more years of military service. The Psychological Corpora- 
tion is willing to assist you in communicating with the 
Department of Defense, but will do so only according to 
your instructions. 



Questions To Be Answered By The Student 

Following are some questions that have been developed by 
the Department of Defense. They are being asked for two 
reasons: (1) to get you thinking about some of the things that 
a tour of military service can provide, and (2) to permit a 
match of your personal needs and goals with Department of 
Defense opportunities, so that if you are interested, you can 
receive information about how the Department of Defense 
can help you meet those needs and goals. 

Please answer all questions. Make no marks except in the 
spaces provided. Be sure your marks are heavy and black. 
Erase completely any answer you wish to change. 



1. Do you want The Psychological Corporation to send 
your test scores to the Department of Defense so that 
the Department can contact you directly about edu- 
cational and vocational programs, opportunities, 
and benefits that are related to your needs and goals? 
(Answering yes to this item means that your name 
and test information will be released to the Depart- 
ment of Defense for this purpose.) 

O Yes 

O No 

If you answered Yes to Question 1 go to Question 3. 

If you answered No, answer Question 2 before going 

to Question 3. 

2. Do you want The Psychological Corporation to in- 
form you about the Department of Defense's educa- 
tional and vocational programs and benefits? (An- 
swering yes to this item means this information will 
be sent to you in the mail; your name and test infor- 
mation will not be released to the Department of 
Defense.) 

O Yes 

O No 

3. How sure are you of your educational and/or voca- 
tional plans and goals? 

O Very sure 

O Fairly sure 

O Not sure 

4. How does availability of financial support affect 
your plans to continue your education? 

O Intend to go on, finances not a problem 

O Intend to go on, but will have to find financial 
support 

O Not going on because of lack of financial sup- 
port 
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5. After high school, how easy or difficult do you think it 
will be for someone your age to find a full-time job in 
your geographical area? 

O Almost impossible 

O Very difficult 

O Somewhat difficult 

O Not difficult 

O Don't know 

6. Regarding your joining the military, would your 
parents be: 

O In favor of your joining 
O Against your joining 
O Neutral 

O Don't know, haven't discussed it with them 

7. Has your guidance counselor discussed military career 
opportunities with you? 

O Yes, has encouraged me to look into the military 

O Yes, has discouraged me from looking into the 
military 

O No, has not discussed this option with me 

8. Are any of your close friends or relatives currently serv- 
ing in any branch of the armed forces? 

O Yes 

O No 



9. Do you know that if you qualify you can select the 
training and occupation you want before entering the 
military? 

O Yes 

O No 

10. Are you aware that individuals can take college courses 
while in the military and have 75% of their tuition paid 
by the military? 

O Yes 

O No 

11. Do you have any history of physical problems other 
than routine childhood illnesses? 

O I have not had any physical problems 

O I have had physical problems, but not in the last 
year 

O I currently have physical problems requiring a 
doctor's care 

12. What do you plan to do after you graduate from high 
school? 

O Go to a 2-year college 
O Go to a 4-year college 
O Attend a vocational/ technical school 
O Get a job 
O Join the military 
O Other 
O Undecided 
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APPENDIX B 



Professional Articles Generated by PsyCor 
Project in Massachusetts 



1. American Psychological Association 83 

2. American School Board Association 85 
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June 1983 



AMERICAI PSICBOLOGICAL ASSOCIATIOI 
MOIITOB 



Tests get kudos in Keokuk, 
banned in Boston 



By Kathleen Fisher 
Staff Writer 

A Department of Defense pilot 
program to recruit more “high 
quality" high school students 
through offering them two estab- 
lished commercial aptitude tests 
appears to be having mixed results. 

The commercial vocational apti- 
tude tests could supplement, but 
probably not replace, the DoD’s 
Armed Serv ices Vocational Aptitude 
Battery (ASVAB), which has been 
used in high schools since 1973. 

Since last spring, the military has 
been paying American College Test- 
ing (ACT) to administer its Career 
Planning Program in the West and 
Midwest. A similar arrangement 
with the Psychological Corporation 
(Psych Coip) to give its Ekvelop- 
mcntal Aptitude Test began last fall 
in New England. 

Those involved with the project 
believe this is the first lime an outside 
non-cducational agency has spon- 
sored administration of commercial 
school tests. This new relationship 
has posed some ethical and legal con- 
cerns. 

Most of those concerns center on a 
12-item .questionnaire that is 
appended to the lest. If the student 
agrees, the test results and completed 
queries about his or her attitude to- 
ward the military will be forwarded 
to the defense departnnent. Critics of 
the program have suggested that the 
questions violate privacy laws and 
pans of the American Psychological 
Association’s ethical code rrganiing 
conflict of interest and informed con- 
sent. 

Under the assumption that the 
ASVAB will continue to be an im- 



portant component of the military 
testing program — one version is 
administered to all new recruits so 
that they can be assigned to an appro- 
priate specialty — two committees of 
outside psychometricians and other 
testing experts are attemping to re- 
vamp the ASVAB and the way DoD 
goes about marketing it. 

Steve Sellman, a psychologist 
who is assistant director for acces- 
sion policy (military personnel test- 
ing) in the defense secretary’s office, 
explained that the DoD has been con- 
cerned that only about 1 1 percent of 
the high school students in the coun- 
try are given the ASVAB. Its validity 
has been questioned, particularly its 
appropriateness for counseling stu- 
dents in regard to civilian careers. 
Some of that criticism has been war- 
ranted, Sellman said. 

Image tarnished 

The ASVAB’s image problems 
were compounded in 1980, when it 
was discovered that all versions were 
miscalibrated. The error had allowed 
250,000 unqualified recruits to enter 
the military in the previous four 
years. 

The two commercial tests, usually 
referred to as the CPP and the DAT, 
are among only four or five that met 
the defense department’s standards, 
Sellman said, and were selected 
through competitive bidding. 

The carrot dangled before targeted 
high schools — the project was 
aimed at those which had not been 
offering the ASVAB — was free ac- 
cess to tests that would normally cost 
$2,000 to $3, (XX) to administer to a 
large high school class. 

In return, they had to include 12 



questions about the students* goals 
and knowledge of and interest in 
military careers. 

“In the Midwest and West, it has 
worked pretty well, so we could say 
on the surface it appears to be a suc- 
cess,*’ Sellman said of the program. 
“In New England, the enthusiasm 
has been less than overwhelming.’’ 

In fact, when the test was given in 
Cambridge, Mass., it created such a 
flap among parents and school boiird 
members that the administration 
agreed to destroy all the response 
sheets. 

“There was a feeling among some 
people that we were helping the 
military,’’ said Henry Lukas, head- 
master at Cambridge Rindge and 
Latin High School, the only public 
high school in the Boston suburb. 
“Even when you say you’re not going 
to release the infonnalion, there are 
people here who don’t trust the 
military.** 

A choice 

The first item on the accompany- 
ing questionnaire asks if students 
want the testing company to share the 
scores with the Department of De- 
fense so the department can contact 
them. The second asks if they would 
prefer to have the company send 
them material about military pro- 
grams without forwarding their name 
to the DoD. If they answer “yes’* to 
the first question, they are asked to 
answer the other 10. 

Such problems have not arisen in 
regard to the ASVAB, because each 
school makes a decision for all its 
students on whether the test scores 
will be released to DoD. Despite the 
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Cambridge experience, so far New 
England students have been much 
more willing to pass along their test 
results than have their western coun- 
terparts. 

When the test was given in New 
England, from 25 to 45 percent of the 
students agree to have their names 
released to the DoD. 

In the West and Midwest, where 
ACT has completed its part of the 
pilot study, only 15 percent of the 
students agreed to release their test 
results, although 40 percent in- 
dicated they would like to receive 
more information on the services. 

The problem is that very few of the 
New England schools are offering 
the test package. The goal for each 
contract was to administer the test to 
50,000 students. ACT was only 
about 150 students under that goal. 
But Psych Corp administered the test 
to only 3,000 students last fall, and is 
anticipating that only another 5,000 
will take the DAT under the defense 
program this spring, a defense offi- 
cial said. 

“When we started the pilot pro- 
gram,'* Sellman said, “we wondered 
if the problem was with ASVAB or 
with us. In New England,' apparently 
it*s us.** 

' Glenn Koocher, a member of the 
Cambridge School Committee, said 
his concern about the test centered on 
his belief that it was a violation of 
student and family privacy. The 
committee voted to impound the 
tests, and eventually destroyed the 
responses. 

Sellman said the testing com- 
panies have encouraged school dis- 
tricts to send letters home to parents 
explaining the test and its purpose 
before it is given. 



‘They’re quite openly interested in 
getting more names,’* said Jerome 
Doppclt, vice president and director 
of Psych Corp*s psychological 
measurement's division. “There's 
nothing secretive about it.** Lawyers 
for both parties involved in the con- 
tract examined the privacy question 
and concluded that there was no 
violation involved, he added. 

D on Bersoff, APA general 
counsel . said the test seems to 
fall under restrictions im- 
posed by the Family Educational 
Rights and Privacy Act. That law 
says that educational records cannot 
be shared with a third party without 
affirmative consent of the parents. 

Ethical issues 

Gerald Koocher, a Harvard psy- 
chologist and and Glenn Koocher’s 
brother, said he is concerned that the 
DoD testing program created poten- 
tial ethical violations of the APA 
Ethical Principles. Those include 
establishing relationships that may 
create a conflict of interest; actions 
that could diminish the civil rights of 
clients; exploitation of the trust and 
dependency between the psycholo- 
gist and client; and failure to fully 
clarify the purpose of an assessment 
tool. 

Leonard Goodstein, an APA 
ethics committee member, said that, 
as long as students arc aware of who 
is sponsoring the test and retain the 
right not to fill out the questionnaire, 
“why is it unethical to help recruit for 
the. military? 

“It would be different if we were 
recruiting them for prostitution or 
drug use. But the end result is not 
immoral.** ■ 
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A military recruiting 

strategy draws fire 



Once upon a simpler time, the U.S. mili- 
tary could swell its ranks merely by slap- 
ping up some posters of a bearded old 
gentleman announcing, “I want you.” As 
you might imagine, things are a tad more 
complicated these days. 

Consider, for instance, what happened 
when the military tried a slightly softer 
sell involving schools: As part of a pilot 
program recently completed with the help 
of two well -respected testing firms, 
thousands of U.S. high school students 
took career aptitude tests at no cost to 
them or their school systems. All the stu- 
dents had to do was complete a special 
supplemental career survey and agree to 
have the test results passed on to a poten- 
tial employer— the Department of De- 
fense (D.O.D.). 

The arrangement suited most of the 
schools involved just fine. Of course, no 
such arrangement is able to please 
everybody. In at least one school system, 
the D.o.D. -sponsored program raised 
quite a ruckus. 

First, some background: Under a pro- 
gram begun two years ago, d.o.d. con- 
tracted with the American College Testing 
Co. (a.c.t.) of Iowa City and the Psycho- 
logical Corp. of New York City (a divi- 
sion of Harcourt, Brace, Jovanovich) to 
test the career aptitude of 100,000 high 
school juniors In the West, Midwest, and 
New England. In the program (poetically 
slugged as Commercial Testing to Supple- 
ment D.O.D. High School Testing), par- 
ticipating students were asked to complete 
a supplementary 12-question survey pre- 
pared by D.O.D. The supplementary ques- 
tions were to be answered when the stu- 
dents took cither a.c.t. *s Career Planning 
Program Test or Psychological Corp.’s 
Differential Aptitude Test. (Both tests 
generally arc acknowledged by school ad- 
ministrators to be excellent but expensive 
instruments, costing schools approxi- 
mately S5 per student.) The results of the 



aptitude tests and the responses to the, 
D.O.D. survey then would be sent to the 
Defense Department for recruiting pur- 
poses. In schools that chose to partici- 
pate, students were required to take the 
three-hour aptitude test. The d.o.d. sup- 
plemental survey was optional, and stu- 
dents were advised that they could refuse 
to answer any or all of the military’s ques- 
tions and still receive results of the apti- 
tude test — free. 

According to the program’s coordina- 
tor, Nancy Nieboer, currently adjunct re- 
search professor at the Naval Postgradu- 
ate School in Monterey, Calif., d.o.d. 
paid A.C.T. and Psychological Corp. 
approximately $200, CKX) each (depending 
on the number of students tested) to ad- 
minister the tests and the supplemental 
survey. The arrangement applied only to 
schools that were not already providing 
students the opportunity to take d.o.d. ’s 
own aptitude and recruiting instrument, 
the Armed Services Vocational Aptitude 
Battery (asvab). In recent years, asvab 
has fallen out of favor with many stu- 
dents and school counselors, and d.o.d. 
has been worried about not reaching the 
kind of students it wants to recruit (read: 
high school graduates). Nieboer explains 
that the program was designed (1) to 
.reach potential recruits of a high caliber 
through the commercial standardized 
tests and (2) to find a more successful 
means of access to potential recruits. 

The D.O.D. survey that accompanied 
the commercial tests consequently in- 
cluded specific questions, such as the fol- 
lowing, which come with the a.c.t. ver- 
sion: “How does the availability of finan- 
cial support affect your plans to continue 
your education?”; “After high school, 
how easy or difficult do you think it will 
be for someone your age to find a full- 
time job in your area?”; “Regarding join- 
ing the military, would your parents be: 
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(A) in favor of your joinings (B) against 
your joining, (C) neutral, (D) don't know 
. . “Are any of your close friends or 
relatives currently serving in any branch 
of the armed forces?”; and “Are you 
aware that individuals can take college 
courses while in the military and have 75 
percent of their tuition paid by the mili- 
tary?” 

The pilot program, however, didn’t 
reach its goal of 100,000 students. Al- 
though A.c.T. tested more than 48,000 
students in nine states (California, 
Oregon, Washington, Minnesota, Ohio, 
Indiana, Michigan, Kentucky, and Iowa), 
Psychological Corp. tested fewer than 
10,{XX) students. Nieboer says Psychologi- 
cal Corp. had some difficulty finding eli- 
gible (and willing) participants, because 
“many of the schools in New England 
tend to be small, private schools that his- 
torically have not been interested in mili- 
tary involvement and recruiting.” She 
says A.c.T. ’s approach to administering 
the tests appears to have been more suc- 
cessful, perhaps in part because the test- 
ing company advised schools to arrange 
pretest information sessions and to in- 
volve parents in career planning sessions 
in conjunction with testing. 

One site at which a.c.t. administered 
Jhe D.o.D. program was Ann Arbor, 
Mich. In April 1982, parents of nearly 400 
juniors at Pioneer High School received 
a two-page letter from school administra- 
tors explaining the school’s imminent par- 
ticipation in A.C.T. ’s Career Planning 
Program. The letter suggested several 
ways parents could become involved in 
the process, such as attending a parents’ 
night at school. The letter also said, in 
part, “It is possible that the source of 
funding for the project will be the Depart- 
ment of Defense” and that “interested 
students” would be provided “the oppor- 
tunity to request information about train- 
ing and educational opportunities in the 
military services.” The letter also said, 
“Such information would be provided 
only to students who request it. No infor- 
mation would be released unless the stu- 
dent authorizes a release.” Reaction from 
students, parents, and teachers to the 
A.C.T. test and the d.o.d. survey was 
good, says Thomas MacKenzie, the Ann 
Arbor school system’s director of guid- 
ance and testing. There were some com- 
munity objections to d.o.d. ’s involve- 
ment in the tests, but MacKenzie dis- 
misses these. Says he: “I’d rather have the 
military invest in education than in guns 
or tanks.” 

Things didn’t go so smoothly in 



another school system. In fact, objections 
from students, parents, and community 
members to the involvement of 500 stu- 
dents at Cambridge (Massachusetts) 
Rindge and Latin High School were so 
strong that the school committee (board) 
ordered the test answer sheets destroyed 
before they ever reached the testing com- 
pany. The objections focused on the fact 
that the test was being used for military 
recruiting. Critics also alleged the ac- 
companying survey questions constituted 
an invasion of privacy. “Some parents 
complained students had to give certain 
personal information they didn’t want the 
Defense Department to get hold of,” says 
Henry Lukas, assistant headmaster of the 
school. Lukas notes that although stu- 
dents were informed of the test several 
days before it was given, their parents and 
the school committee were not told 
formally about the school’s involvement 
in the d.o.d. pilot program. Complaints 
started coming in right after the test was 
administered, and articles in the local 
newspapers added to the controversy. 
School administrators held on to the 
answer sheets and, complying with com- 
munity sentiment, tried to negotiate with 
Psychological Corp. to score and release 
the aptitude test results without sending 
any information to d.o.d. The testing 
organization refused, and the school com- 
mittee directed school administrators to 
destroy all test answer sheets. About the 
furor, a project director at Psychological 
Corp. comments, “Confidentiality of the 
test results probably was an issue in 
Cambridge, because people might have 
felt that the Defense Department might 
be acting as Big Brother.” 

Nancy Nieboer characterizes the flap in 
Cambridge as “miscommunication be- 
tween the testing corporation and school 
administrators.” She says Cambridge 
Rindge and Latin was “the only location 
approached by either testing company 
that presented any problem.” The pilot 
program is ended, but she says it’s too 
early to tell how successful recruiting 
efforts have been. 

Without conscription, d.o.d. has to 
find some way to entice bright young 
people into uniform. Because posters of 
Uncle Sam don’t seem to have the draw- 
ing power they us^d to, slipping a few 
leading questions into a supplemental 
survey probably seemed to somebody like 
a wily way for the uniformed services to 
approach their recruit quotas. The effi- 
ciency of the tactic might seem slightly 
tenuous, but then, subtlety never has been 
the military’s finest aptitude. □ 
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APPENDIX C 



Service Reports on Commercial Aptitude Testing 

Pilot Projects 



1, Department of the Army: 

Army Recruiting Command and MEPCOM 89 

2, Department of the Air Force: 

Air Force Recruiting Service 97 

3, Department of the Navy: 

Navy Recruiting Command and Marine Corps 103 



87 



DEPARTMENT OF THE ARMY 

OFFICE OF THE DEPUTY CHIEF OF STAFF FOR PERSONNEL 
WASHINGTON, DC 20310 



REPLY TO 
ATTENTION OF 



DAPB-MPA-CS 



8 MAR 1983 



FOR DEPUTY ASSISTANT SECRETARY Or uorrii^or. 
(MILITARY PERSONNEL & FORCE MANAGIIIENT) 



MMORANDUM THRU QH IRF QF - STAFF 
AS SISTANT SECR: 




4 MAR 1333 



SUBJECT: Commercial Testing to Supplement the DoD High School 

Testing Program — INFORMATION MTMORANDUM 



The following information is submitted in response to your 7 Dec 82 memo- 
randum (TAB A): 

a. Military Entrance Processing Command (MEPCOM) . 

(1) Number of juniors/seniors tested with ASVAB during school year 
1990-81 in each high school participating in the commercial testing pilot 
program is at TAB B. 

(2) List for school years 1981-82 and 1982-83 is at TAB C. 

(3) List of schools participating in the pilot program but not on 
file in the MEPCOM computer is at TAB D. 

(4) Reactions of schools participating in the commercial testing 
program cannot be addressed since the only action required by MEPCOM was 
to provide lists of schools for testing. 

(5) MEPCOM is gathering information from Military Entrance Processing 
Stations in areas that participated in the pilot program. Recommendations will 
be made in the final evaluation due in September 1983* 

b. United States Army Recruiting Command (USAREC). 

( 1 ) Assessment of the value of the program could not be made at this 
time since the results from fall testing in New England were not available in 
sufficient time to determine the nvimber of leads, appointments, or contacts. 

(2) At the midway point in reporting results of the testing, there 
does not appear to be any firm positive or negative reaction to the program. 

The comments cover a wide spectrum as indicated below: 
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DAPI^MPA-CS 

SUBJECT: Commercial Testing to Supplement the DoD High School 

Testing Program — INFORMATION MMORANDUM 

(a) Strongly recommend that the DAT be discontinued. 

(b) Recommend expanding the CPP to the 83-84 school year 
as a means of determining effectiveness. 

(c) It appears that there is some reluctance on the part 
of school administrators and counselors to use ASVAB because it denotes 
Armed Services and is viewed strictly as a military test. However, when 
coupled with a commercial test, ASVAB credibility is enhanced and is con- 
sidered a viable source for student area exploration. 

(d) One routine rejection of ASVAB is timing relative to 

scheduling it into school programs. The supplemental civilian testing 
surfaced similar comments, but this time the rejection of the ASVAB was 
based on a DoD sponsored competitor test: For example, several schools 

were willing to participate in the DoD sponsored CPP testing program, 
but in so doing, they woiild not have time to schedule ASVAB. 

(e) While the preponderance of negative comments seems to 
have originated from New England, it appears that there are a number of 
positive reactions coming from the Midwest. 

(f) Reactions in Minnesota were favorable, with most schools 
supporting the idea of DoD sponsoring a commercial test in a period of di- 
minishing state and federal funds. 

(g) Recruiters in the Midwest indicate that the information 
included in the report for use by recruiters provided good insight on pro- 
spective applicants, and in some cases, the commercial test was the instru- 
ment that permitted increased access to schools. 

(3) More accurate statistics and specific comments relative to the 
impact of commercial testing on the recruiting mission are expected to be 
available for the September 1983 report. 

FOR THE DEPUTY CHIEF OF STAFF FOR PERSONNEL: 




Colonel, GS 

Chief, Accession Division 
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Mr. Ruberton/50836 
Typed by: N. DeAtley 



DEPARTMENT OF THE ARMY 

OFFICE OF THE C-IPUTY CHIEF OF ETAFF FOR PERSONNEL. 
WASHINGTON. DC X0310 




2 1 OCT 1983 



MEMORANDUM THRU Ofi lEP OF & TAPF, ARMY - ‘ ‘ DAPE-MPA 

ASSISTANT SECRETARY OP THE ARMY (M&RA) 



FOR DEPUTY ASSISTANT SECRETARY OP DEFENSE 
(MILITARY PERSONNEL 4 FORCE MANAGEMENT) 



SUBJECT: Commercial Testing to Supplement the DOD High School 

Testing Program — INFORMATION MEMORANDUM 



The following additional information is submitted in response to 
your 7 Dec 82 memorandum (Tab A). An interim reply was forwarded 
on 8 March 1983* 

a. ' Military Entrance Processing Command (MEPCOM) « 

(1) Number of juniors/seniors tested with ASVAB during 
school years 1980-81, 1981-82, 1982-83 in each school par- 
ticipating in the commercial testing pilot program was submitted 
in the interim report. 

(2) Responses to other specific questions required from 
MEPCOM are at Tab B. 

(3) No specific recommendations regarding future use of 
commercial testing to supplement the high school ASVAB were sub- 
mitted since the questions and answers at Tab B address MEPCOM' s 
observations . 

b. United States Army Recruiting Command (US AREC) . 

Responses to the specific requirement to submit reactions of 
schools participating in the DOD-sponsored commercial testing 
program, District Recruiting Command reactions, and recommen- 
dations regarding future use of commercial testing to supplement 
the high school ASVAB are at Tab C. 

FOR THE DEPUTY CHIEF OF STAFF FOR PERSONNEL: 



Enclosures 




Chief, Accession Division 
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MEPCOM 



QUESTIONS AND ANSWERS ON COMMERCIAL TESTING 



a. Are schools more receptive to information about the military as a career 
option as a result of the commercial testing program? 

Schools seem to be evenly divided on receiving military information. Some 
want to receive this information, others could care less. Students appear 
to be more receptive after taking the commercial test; however, it is not 
known if it is because of the test or economic conditions at this time. 

b. Are schools more or less interested in using the Armed Services Vocational 
Aptitude Battery (ASVAB) after using the commercial instrument? 

Schools are less interested in using the ASVAB after using the commercial 
test. 

c. Would the schools prefer using the commercial test rather than the ASVAB? 

Schools were divided on the use of the commercial test versus the ASVAB. 
Some responded that they prefer the commercial test because H appears 
to have no connection with the armed services. 

d. Would the schools consider using both 000 sponsored commercial tests and 
ASVAB? 

The majority of schools contacted would not consider using both the 
ASVAB and the commercial test because of time constraints. 

e. Would the schools prefer having no testing sponsored by- BOB? 

Most schools prefer BOB sponsored tests and woyld not consider removing 
them from their testing program. 

f. Has the administration of this comnercial instrument caused any 
turbulence in MEPS areas of responsibility that has had any detrimental 
impact on ASVAB testing? 

Most MEPS feel that the comnercial instrument has had some adverse effect 
on its ASVAB programs. It has become more difficult to promote the 
ASVAB in those schools that took the commercial test. 

g. Have any school in MEPS areas of responsibility cancelled ASVAB testing 
because the commercial instrument was not offered to them? 

No schools have cancelled ASVAB testing because they have not been offered 
the comnercial test. Several schools have threatened cancellation 
because other schools in its school district were offered the test and 
they were not. MEPS personnel and recruiters were able to overcome this 
threat and administer the ASVAB as scheduled. 
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h. Kas any school declined to schedule ASVAB testing because they have not 
been offered the connerclal test? 

No schools have declined to schedule the ASVAB because they were not 
offered the comraerclal test. 

I. Recruiting district coninanders In Indiana have expressed concern that a 
lack of followup by ACT may cause a decrease In the value of the program. 



NOTBt 



MEPOOM conclusions are that the program has merit but should be evaluated 
by a disinterested outside civilian agency for recommendations on how to proceed 
with such a program. 



2 
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DEPARTMENT OF THE ARMY 

HCADQUARTCRS UNITED STATES ARMY RECRUITING COMMAND 
FORT SHERIDAN. ILLINOIS 60037 



2 9 SEP »983 



SUBJECT: Commercial Testing to Supplement the DOD High School Testing ‘Program 



HQDA (DAPE-MPA-CS) 
WASH DC 20310 



1. Reference letter, DAPE-MPA-CS, HQDA, 13 Dec 82, SAB. 

2. In compliance with the request In the referenced letter, the following 
Information Is provided. 

a. Results of Differential Aptitude Test (DAT) testing by the Psychological 
Corporation in New England: 

(1) Though the statistics from the field were not consistent with 

the contractor's report on the number of students tested and number of students 
authorizing direct contact, the data did show that a total of 732 students 
(of the 6,830 tested) were contacted by recruiters. Of that number, 218 
(30 percent) appointments were conducted and 2. (3 percent) contracts resulted 
(See Inclosed consolidated DAT results). 

(2) School reactions to the program: Most of the schools were favor- 

able to the program, with some expressed reservation concerning the completion 
of the survey prior to the test (l.e., they wanted the test; but perhaps not 
the military contact). This Is not surprising, considering that one reason 
for not utilizing the ASVAB Is probably the perceived military connection. 

While some schools expressed a desire to continue with the DAT program, only 

a few Indicated they would like to participate In the ASVAB program. 

(3) DRC reactions to the program: Mixed reactions were generated by 

the program. Some said discontinue completely, others that it could be 
expanded. Problems expressed dealt with lack of communication/coordination 
with the contractor and the delayed receipt of results and leads. Most felt 
that the Information contained In the survey was very helpful, but It did not 
seem to translate Into contracts - It just made the telephonic contact more 
comfortable. 

(A) Recommendations for the program: Commercial testing through the 

Psychological Corporation seems to have been less than a resounding success 
due to the low numbers tested and that testing was essentially done In schools 
that had a low priority to the recruiting force. The testing did not, appar- 
ently, have an appreciable effect on turning the situation around In New 
England, at least in terms of generating Increased access to difficult schools 
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USARCRO-RS 

SUBJECT: 



2 9 SEP Ibdo 

Commercial Testing to Supplement the DOD High School Testing Program 



or generating contracts. That it provided leads not previously available, 
is true, but those leads were not converted into contracts. It may have been 
somewhat beneficial image-wise, but perhaps the money spent could have been 
utilized in other public relations type events that would be just as beneficial 
in this respect. 



b. Results of Career Planning Program (CPP) testing by American College 
Testing (ACT) in the midwest/west. 

(1) Again, statistics from the field were not consistent with the con- 
tractors report in numbers tested or leads generated. Under the CPP program, 

1 , 796 contacts were made from the leads provided, 484 (27 percent) appointments 
were conducted, ^ (8.5 percent) contracts resulted. Considering the actual 
number of students tested in the Army part of the progranr (approximately 24,500) 

the contract to tested ratio is about .002 (See Inclosed consolidated ACT/CPP 

results) . 

(2) School reactions to the program: Most schools reacted very favor- 

ably to- the program. ACT seems to have a good reputation and credibility, and 
counselors seemed to like CPP. California schools were somewhat lukewarm, 
but not negative. There was one comment on the need for better post-test 
followup. 

(3) DRC reactions to the program: Again, reactions to the CPP program 

were favorable. One mention was made of a perceived low correlation for the 

predicted AFQT and that the program, perhaps, was not necessary in a state 
where ASVAB was doing well. However, there was not real expressed objections 
and ACT seems to have done an effective job of communlcatlng/coordinating the 
program, after the Minnesota experience. Not all DRCs were aware of how many 
had tested in their area (reported 15,000 versus nearly 25,000) and this should 
be cleared up, but most knew the leads generated. Recruiters liked the results 
received, though some comment was made on low number of students actually 
requesting contact. 

(4) Recommendations for the program: Some recommended continuing this 

program only for schools not ASVABing; some said expand it; but all said con- 
tinue it! The initial results are favorable and certainly the contractor has 
done a creditable job. Improvements/refinements are anticipated this year 

in the program. However, there is the possibility, at least in the field, 
that CPP is being viewed as a replacement for ASVAB and that, therefore, it is 
competing. This factor could have some adverse effect, because improvements 
in the ASVAB program are being made. Considering that only 41 contracts re- 
sulted (and half of those were in Minnesota, where a great number of schools 
tested had also been using the ASVAB), it may be that the commercial testing 
program is not totally cost effective. 

FOR THE COMMANDER: 



2 Incl 
as 

Director, Recruiting Operations 
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DEPARTMENT OF THE AIR FORCE 

WASHINGTON 20330 



OFFICE OF THE ASSISTANT SECRETARY 




3 March 1983 



MEMORANDUM FOR DEPUTY ASSISTANT SECRETARY (MILITARY PERSONNEL AND 
FORCE MANAGEMENT) OFFICE OF THE ASSISTANT SECRETARY 
OF DEFENSE (MANPOWER, RESERVE AFFAIRS AND LOGISTICS) 

SUBJECT: Commercial Testing to Supplement the DoD High School 

Testing Program (Your Memo, December 7, 1982) - 
INFORMATION MEMORANDUM 

Attached are the interim data and reactions requested for evalu- 
ation of the commercial testing program. Comprehensive data 
concerning prior and current Fiscal Year contracts plus leads, 
appointments and contracts obtained from commercial testing are 
not available for this report. We anticipate having this 
information for our final report. Sept 30, 1983. 

Overall, we believe the current favorable recruiting environment 
makes proper evaluation of commercial testing difficult. The 
initial reactions of recruiting personnel and schools involved 
in the pilot program are favorable. However, the lack of tele- 
phone numbers for commercial test leads was identified as a 
limitation relative to other lead lists, e.g., the high school 
ASVAB. We appreciate the opportunity to participate in this 
evaluation. 



KAREN R. KEESLING 
Deputy Assistant Secretary 
(Manpower Resources and Military Personnel) 




1 Attachment 
Specific Responses 
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U.S. Air Force Recruiting Service 

SPECIFIC COMMENTS, COMMERCIAL TESTING PROGRAM (INTERIM REPORT, FEB 83) 



1. Nuinber of seniors contracted by each Service in FY 1981, 1982 and 1983 
(active and delayed entry) in each high school participating in the high school 
testing program: 

Headquarters, USAF Recruiting Service is unable to provide this information for 
the interim report. They are working with individual recruiting offices to 
obtain specific data by high school for the final report. 



2. Number of leads appointments and contracts obtained through the comnercial 
testing program in each participating school: 

Again, this information is not available in the requested format. We do have the 
following data available: 



Squadron 


Location 


Recruiter 

Reports 


Schools 

Tested 


3554 RS 


Selfridge, MI 


1,316 


47 


3561 RS 


Seattle, WA 


77 


6 


3562 RS 


Norton AFB, CA 


183 


10 


3566 RS 


Travis AFB, CA 


12 


1 


3569 RS 


Los Angeles, CA 


33 


7 


TOTAL 




1,621 


71 



Since the 3554 Recruiting Squadron received 82% of our recruiter reports from 66% 
of the schools tested, they have had the most experience with the pilot test. Of 
the 1,316 reports they received, 413 were determined to be good leads (age and 
mentally qualified, complete addresses, etc.). From these 413, they secured 35 
appointments which resulted in 10 contracts. No other squadron had this data 
available for the interim report. 



3. Reactions of schools participating in the DoD-sponsored commercial testing 
program: 

(a) 74% of the schools are more receptive to information about the 
military. 

(b) 63% of the schools are less interested in ASVAB use; 37% more 
interested. 

(c) 87% prefer commercial tests to ASVAB; 13% prefer DoD-sponsored 
commercial tests in combination with ASVAB; 0% prefer no DoD testing at all. 



4* District /squadron recruiting conmand reactions to the commercial testing 
program and its value to recruiting: 

(a) 58%, extremely valuable. 

(b) 21%, somewhat valuable. 

(c) 17%, no opinion. 

(d) 0%, somewhat worthless. 

(e) 4%, extremely worthless. 
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5. Recommendations regarding future use of commercial testing to supplement the 
high school ASVAB: 

(a) 71%, definitely should be continued. 

(b) 12%, probably should be continued. 

(c) 4%, undecided/no opinion. 

(d) 8%, probably should not be continued. 

(e) 4%, definitely should not be continued. 



6. Additional Comments: 

(a) Recruiting Service personnel indicated that the number of appointments 
and/or contracts may not properly reflect the success or failure of this pilot 
study. Since leads were received when available jobs were extremely limited and 
the recruiting environment favorable, their value may not be as apparent as 
during more difficult recruiting periods. 

(b) Commercial test leads have been criticized because phone numbers were not 
supplied and establishing personal contact proved difficult. As a result, 
commercial leads were rated inferior to leads from ASVAB lists which do provide 
phone numbers. 
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DEPARTMENT OF THE AIR FORCE 

WASHNQTON 20330 



OFFCe OF the A88BTAMT 9f OWETAHV 



27 October 1983 



mmdrandum for deputy assistant secretary (military personnel and force 

MANAGBIENT), OFFICE OF THE ASSISTANT SECRETARY OF DEFENSE 
(MANPOWm, RESERVE AFFAIRS AND LOGISTICS) 

SUBJECT; Ccranercial Testing to Supplement the DoD High School Testing 
Program (Your Memo, December 7, 1982) - INFORMATION MBORANDIM 

Attached are the final data for evaluation of the pilot program. Per 
discussion between the sponsoring Services, the Military Entrance Processing 
Command (MEPCOM), and Dr. W. S. Sellman, OASD(MRA8L)(MP8FM), Accession 
Policy on 28 July 1983, data pertaining to the nunber of seniors by high 
school is not provided. Instead, we have furnished a monthly breakout of 
total and age-qualified leads who requested additional information and/or 
recruiter contact through our opportunity center, which should be more 
meaningful. 

Overall, we believe the current favorable recruiting environment makes 
comprehensive evaluation of commercial testing difficult, particularly when 
attanpting to measure new contracts which resulted from this program. 
However, our decision to continue funding the program in FY84 is indicative 
of our positive reaction to this initial effort. We believe the increased 
receptiveness of participating schools to military recruiters, which was 
docimented in our interim response, will provide long-term dividends as the 
economy improves and recruiting becomes more difficult. 

KAREN R. KEESLING ^ 

Principal Deputy Assistant Secretary 
(Manpower, Reserve Affairs & Installations) 



1 Attachment 
Specific Comnents 
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JSPB^C g»»lgnSj. TEgrUC progr^ (final report, OCT 83) 



1. interim report, 3 March 1983, the Air Force 
received". 621 recruiter, reports in the fall of 1982, which were 14 percent 
of the.to^l tested^ (11,516) in the spring of 1982. In the spring of 1983, 
we received 2,562 recruiter reports, which were 20 percent of those tested 
(12,810) in the fall of 1982. Total applicants tested for the Air Force 
were 24,326. 

2. Of the 24,326 students tested, ACT sent information packages to 4,287 
(37 percent of spring 1982 tests) on 8 September 1982 and 6,020 (47 percent 
of fall 1982 tests) on 17 March 1983. The total nunber of information 
packages sent (10,307), represented 42 percent of all Air Force applicants 
tested. Mailback cards asking for additional information and/or recruiter 
contact have been received by our opportunity center as follows: 



DATE 


AGE QUALIFIED 


TOTAL CARDS 


Oct 82 


228 


290 


Nov 82 


242 


308 


Dec 82 


249 


316 


Jan 83 


253 


320 


Feb 83 


255 


322 


Mar 83 


455 


645 


^r 83 


662 


958 


May 83 


729 


1043 


Jun 83 


737 


1053 


Jul 83 


746 


1067 


Aug 83 


750 


1073 


Sep 83 


756 


1080 


TOTAL 


6062 


8475 



3. The 8,475 students who have responded to the opportunity center 
represent 82 percent of those sent information packages by ACT. The 6,062 
age-qualified responses represent 72 percent of the total mailback and we 
assune the additional 28 percent are, or shortly will be age-qualified, as 
they were all juniors in high school at the time of testing. 



102 




DEPARTMENT OF THE NAVY 

OFFCE OF THC assistant SECRETARY 
(MANPOWER AND RESERVE AFFAJRS) 

WASHfSKSTON O C 203b0 

8 NUV 1983 



MEM3RANDCM FOR IHE DEPOTS ASSISTANT SECRBrAFY OF DEFENSE (MRAiL) (MP&fW) 

Subj: CoTiDercieil testing to si^lement the DGD high schcxsl testing 

program 

Ref: (a) OASD^IRA&L) menDrandun of 7 December 1982 

End: (1) Navy Recruiting Oonroand and Marine Corps final report on 

ccniDercicd testing to si^lement the DCD high school testing 
program 

Reference (a) requested a final report concerning the pilot project to 
si^lement the high school Armed Services Vocational Aptitude Battery (ASVAB) 
with oomroercid tests. 

EiKdosure (1) provides data cKoguired by the Navy (TAB A) and Mcirine 
Corps (TAB B) . 

Neither the Navy nor Maurine Corps recruiting organizations consider 
pilot program results sufficiently conclusive thus far to permit substantive 
appraisal of the program as a prospect-qualifying or lead-generating device. 
Because Navy Recruiting Coranand was not involved in FY83 testing conducted 
under American College Testing (ACT) auspices, it prefers to await results 
and analysis of the FX84 program administered by that contractor before 
ccmnitting further to the si^plementary effort. Marine Corps will continue 
to participate in the oonmercid testing program through FY84. 

Doth the Navy and Mcurine Corps will pursue aggressive marketing of the 
high school ASVAB to schools not currently participating in that or the 
supplementary commercial program. Navy Recruiting Coomand is concerned, 
however, that increasing acceptance of and apparent preference for the ooro- 
mercid test by user schools may hinder ASVAB marketing initiatives once 
more schools eu:e aware of the supplementary program's existence. 

It is recormended that commercid testing be reviewed in late FY84 
and, if continuation is not dected, that funds cdlocated to its support be 
dedicated to upgrskding and inprovement of the high school ASVAB program. 

Respectfully, 




Acting Deputy Assistant Secretary 
of the Navy (Manpower) 
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APPENDIX D 



Military Entrance Processing Stations (HEPS) : 

By Group 



1. CPP and DAT Pilot MBPS 107 

2. MEPCOM Centralized Marketing 

Pilot Program MBPS 109 

3. HumRRO-Selected Centralized 

Marketing Control MBPS 111 
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CPP and DAT Pilot MBPS 



CPP Pilot Group 

Cincinnati, Ohio 
Cleveland, Ohio 
Des Moines, Iowa 
Detroit, Michigan 
Indianapolis, Indiana 
Los Angeles, California 
Minneapolis, Minnesota 
San Diego, California 

DAT Pilot Group 

Albany, New York 
Boston, Massachusetts 
Manchester, New Hampshire 
New Haven, Connecticut 
Portland, Maine 
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MEPCOM Centralized Marketing 
Pilot Program MBPS 



Albany, New York 


New York City, New York 


Atlanta, Georgia 


Newark, New Jersey 


Chicago, Illinois 


Oakland, California 


Denver, Colorado 


Oklahoma City, Oklahoma 


Little Rock, Arkansas 


Salt Lake City, Utah 


Los Angeles, California 


San Antonio, Texas 


Milwaukee, Wisconsin 


Spokane, Washington 


Minneapolis, Minnesota 
Montgomery, Alabama 


St. Louis, Missouri 
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HumRRO-Selected Centralized 
Marketing Control MBPS 



Baltimore, Maryland 
Boston, Massachusetts 
Cleveland, Ohio 
Columbus, Ohio 
Detroit, Michigan 
Fresno, California 
Ft. Jackson, South Carolina 
Jackson, Mississippi 
Jacksonville, Florida 



Miami, Florida 
Nashville, Tennessee 
Philadelphia, Pennsylvania 
Pittsburgh, Pennsylvania 
Portland, Oregon 
San Diego, California 
Seattle, Washington 
Syracuse, New York 
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